The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Understanding and Diagnosing Visual Tracking Systems
Open accessAbstract
Several benchmark datasets for visual tracking research have been created in recent years. Despite their usefulness, whether they are sufficient for understanding and diagnosing the strengths and weaknesses of different trackers remains questionable. To address this issue, we propose a framework by breaking a tracker down into five constituent parts, namely, motion model, feature extractor, observation model, model updater, and ensemble post-processor. We then conduct ablative experiments on each component to study how it affects the overall result. Surprisingly, our findings are discrepant with some common beliefs in the visual tracking research community. We find that the feature extractor plays the most important role in a tracker. On the other hand, although the observation model is the focus of many studies, we find that it often brings no significant improvement. Moreover, the motion model and model updater contain many details that could affect the result. Also, the ensemble post-processor can improve the result substantially when the constituent trackers have high diversity. Based on our findings, we put together some very elementary building blocks to give a basic tracker which is competitive in performance to the state-of-the-art trackers. We believe our framework can provide a solid baseline when conducting controlled experiments for visual tracking research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
(1981) · Cited by 11,963
A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978374 · Cited by 11,502
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Visual object tracking using adaptive correlation filters
Bolme, D., Beveridge, J. R., Draper, B. A., & Lui, Y. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539960 · Cited by 3,406
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · cited 2×
“For a comprehensive survey, readers are referred to [28, 40].”
BackgroundIncremental Learning for Robust Visual Tracking
Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061
Real-time tracking of non-rigid objects using mean shift
Comaniciu, D., Ramesh, V., & Meer, P. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854761 · Cited by 2,906
Online Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
Detection and Tracking of Point Features
Tomasi, C. (1991) · Cited by 2,231
Accurate Scale Estimation for Robust Visual Tracking
Danelljan, M., Häger, G., Shahbaz Khan, F., & Felsberg, M. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.65 · Cited by 2,087
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007
Struck: Structured output tracking with kernels
Hare, S., Saffari, A., & Torr, P. H. S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126251 · Cited by 1,831
Visual Tracking: An Experimental Survey
(2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.230 · Cited by 1,513
Adaptive Color Attributes for Real-Time Visual Tracking
Danelljan, M., Khan, F. S., Felsberg, M., & Van De Weijer, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.143 · Cited by 1,500
Robust Fragments-based Tracking using the Integral Histogram
Adam, A., Rivlin, E., & Shimshoni, I. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.256 · Cited by 1,397
Real-Time Tracking via On-line Boosting
Grabner, H., Grabner, M., & Bischof, H. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.6 · Cited by 1,198
Visual tracking via adaptive structural local sparse appearance model
Jia, X., Lu, H., & Yang, M.-H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247880 · Cited by 1,188
MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization
Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,117
Semi-supervised On-Line Boosting for Robust Tracking
Grabner, H., Leistner, C., & Bischof, H. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_19 · Cited by 1,089
Learning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · neural information processing systems · Cited by 1,014
Self-citationStruck: Structured Output Tracking with Kernels
Hare, S., Golodetz, S., Saffari, A., Vineet, V., Cheng, M.-M., Hicks, S. L., & Torr, P. H. S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2509974 · Cited by 994
Robust object tracking via sparsity-based collaborative model
Zhong, W., Lu, H., & Yang, M.-H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247882 · Cited by 990
(2009) · doi:10.1109/iccv.2009.5459292 · Cited by 779
Matthews, L., Ishikawa, T., & Baker, S. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.16 · Cited by 754
The Visual Object Tracking VOT2014 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Čehovin, L., Nebehay, G., Vojíř, T., Fernández, G., Lukežič, A., Dimitriev, A., et al. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_14 · Cited by 588
Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network
Hong, S., You, T., Kwak, S., & Han, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.06796 · Cited by 491
Transfer Learning Based Visual Tracking with Gaussian Processes Regression
Gao, J., Ling, H., Hu, W., & Xing, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_13 · Cited by 449
PROST: Parallel robust online simple tracking
Santner, J., Leistner, C., Saffari, A., Pock, T., & Bischof, H. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540145 · Cited by 377
In defense of color-based model-free tracking
Possegger, H., Mauthner, T., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298823 · Cited by 370
The Visual Object Tracking VOT2013 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Porikli, F., Cehovin, L., Nebehay, G., Fernandez, G., Vojir, T., Gatt, A., et al. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.20 · Cited by 308
Self-Paced Learning for Long-Term Tracking
Supancic III, J. S., & Ramanan, D. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.308 · Cited by 290
Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines
Song, S., & Xiao, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.36 · Cited by 269
Transferring Rich Feature Hierarchies for Robust Visual Tracking
Wang, N., Li, S., Gupta, A. K., & Yeung, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.04587 · Cited by 268
Self-citationLeast Soft-Threshold Squares Tracking
Wang, D., Lu, H., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.307 · Cited by 262
Online Robust Non-negative Dictionary Learning for Visual Tracking
Wang, N., Wang, J., & Yeung, D.-Y. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.87 · Cited by 192
Self-citationNUS-PRO: A New Visual Tracking Challenge
Li, A., Lin, M., Wu, Y., Yang, M.-H., & Yan, S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2417577 · Cited by 176
Ensemble-Based Tracking: Aggregating Crowdsourced Structured Time Series Data
Wang, N., & Yeung, D. (2014) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 91
Self-citationA Superior Tracking Approach: Building a Strong Tracker through Fusion
Bailer, C., Pagani, A., & Stricker, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_12 · Cited by 78
Pang, Y., & Ling, H. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.346 · Cited by 73
Robust Object Tracking with Online Multi-lifespan Dictionary Learning
Xing, J., Gao, J. G., Li, B., Hu, W., & Yan, S. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.88 · Cited by 64
Online training on a budget of support vector machines using twin prototypes
Wang, Z., & Vučetić, S. (2010) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.10075 · Cited by 27
Tracking Revisited using RGBD Camera: Baseline and BenchmarkPreprint
Song, S., & Xiao, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2823 · Cited by 8
Cited by
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809
Siamese Instance Search for Tracking
Tao, R., Gavves, E., & Smeulders, A. W. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.158 · Cited by 1,208
Learning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199
Learning Dynamic Siamese Network for Visual Object Tracking
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 869
The Visual Object Tracking VOT2015 Challenge Results
(2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.79 · Cited by 666
Metadata
- Authors
- Wang, N., Shi, J., Yeung, D.-Y., & Jia, J.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 3101-3109
- OpenAlex
- W2118345389
- Cited by
- 365
- References
- 45
- FWCI
- 22.58
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.