The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
STCT: Sequentially Training Convolutional Networks for Visual Tracking
Abstract
Due to the limited amount of training samples, finetuning pre-trained deep models online is prone to overfitting. In this paper, we propose a sequential training method for convolutional neural networks (CNNs) to effectively transfer pre-trained deep features for online applications. We regard a CNN as an ensemble with each channel of the output feature map as an individual base learner. Each base learner is trained using different loss criterions to reduce correlation and avoid over-training. To achieve the best ensemble online, all the base learners are sequentially sampled into the ensemble via important sampling. To further improve the robustness of each base learner, we propose to train the convolutional layers with random binary masks, which serves as a regularization to enforce each base learner to focus on different input features. The proposed online training method is applied to visual tracking problem by transferring deep features trained on massive annotated visual data and is shown to significantly improve tracking performance. Extensive experiments are conducted on two challenging benchmark data set and demonstrate that our tracking algorithm can outperform state-of-the-art methods with a considerable margin.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“To apply deep CNNs for tasks with a limited amount of training samples, previous approaches [24, 30] adopt a transfer learning method by first pre-training a deep CNN on a source task with a large scale training data set and then fine-tuning the learned feature on the target task.”
MethodIncremental Learning for Robust Visual Tracking
Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061
Accurate Scale Estimation for Robust Visual Tracking
Danelljan, M., Häger, G., Shahbaz Khan, F., & Felsberg, M. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.65 · Cited by 2,087
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007
Struck: Structured output tracking with kernels
Hare, S., Saffari, A., & Torr, P. H. S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126251 · Cited by 1,831
Hierarchical Convolutional Features for Visual Tracking
Ma, C., Huang, J.-B., Yang, X., & Yang, M.-H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.352 · Cited by 1,776
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
Visual tracking via adaptive structural local sparse appearance model
Jia, X., Lu, H., & Yang, M.-H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247880 · Cited by 1,188
Self-citationMEEM: Robust Tracking via Multiple Experts Using Entropy Minimization
Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,117
Semi-supervised On-Line Boosting for Robust Tracking
Grabner, H., Leistner, C., & Bischof, H. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_19 · Cited by 1,089
EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation
Black, M. J., & Jepson, A. D. (1998) · International Journal of Computer Vision · doi:10.1023/a:1007939232436 · Cited by 1,029
Visual Tracking with Fully Convolutional Networks
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.357 · Cited by 983
Self-citationLearning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836
(2009) · doi:10.1109/iccv.2009.5459292 · Cited by 779
Deep networks for saliency detection via local estimation and global search
Wang, L., Lu, H., Ruan, X., & Yang, M.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298938 · Cited by 676
Self-citationThe Visual Object Tracking VOT2014 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Čehovin, L., Nebehay, G., Vojíř, T., Fernández, G., Lukežič, A., Dimitriev, A., et al. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_14 · Cited by 588
Context tracker: Exploring supporters and distracters in unconstrained environments
Dinh, T. B., Vo, N., & Medioni, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995733 · Cited by 510
Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network
Hong, S., You, T., Kwak, S., & Han, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.06796 · Cited by 491
Transfer Learning Based Visual Tracking with Gaussian Processes Regression
Gao, J., Ling, H., Hu, W., & Xing, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_13 · Cited by 449
DeepID-Net: Deformable deep convolutional neural networks for object detection
Ouyang, W., Wang, X., Zeng, X., Qiu, S., Luo, P., Tian, Y., Li, H., Yang, S., Wang, Z., Loy, C.-C., et al. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298854 · Cited by 430
Self-citationOnline Object Tracking With Sparse Prototypes
Wang, D., Lu, H., & Yang, M.-H. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2202677 · Cited by 416
Self-citationKwon, J., & Lee, K. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126369 · Cited by 374
Yang, F., Lu, H., & Yang, M.-H. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2300823 · Cited by 316
Self-citationRobust Object Tracking via Sparse Collaborative Appearance Model
Zhong, W., Lu, H., & Yang, M.-H. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2313227 · Cited by 307
Self-citationRobust Visual Tracking using 1 Minimization
Mei, X., & Ling, H. (2009) · Cited by 286
Deeply learned attributes for crowded scene understanding
Shao, J., Kang, K., Loy, C. C., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299097 · Cited by 280
Self-citationYang, W., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.335 · Cited by 255
Self-citationVisual Tracking via Probability Continuous Outlier Model
Wang, D., & Lu, H. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.445 · Cited by 113
Self-citationImportance Sampled Learning Ensembles
Friedman, J. H., & Popescu, B. E. (2003) · Cited by 111
Robust Online Visual Tracking with a Single Convolutional Neural Network
Li, H., Li, Y., & Porikli, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16814-2_13 · Cited by 84
Robust Visual Tracking via Least Soft-Threshold Squares
Wang, D., Lu, H., & Yang, M. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2462012 · Cited by 78
Self-citationLearning Mutual Visibility Relationship for Pedestrian Detection with a Deep Model
Ouyang, W., Zeng, X., & Wang, X. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0890-9 · Cited by 52
Self-citationMulti-task Recurrent Neural Network for Immediacy Prediction
Chu, X., Ouyang, W., Yang, W. P., & Wang, X. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.383 · Cited by 50
Self-citationZhang, L., Lu, H., Du, D., & Liu, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2509244 · Cited by 36
Self-citation
Cited by
The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., & Tian, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_23 · Cited by 1,099
Learning Dynamic Siamese Network for Visual Object Tracking
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 869
Large Margin Object Tracking with Circulant Feature Maps
Wang, M., Liu, Y., & Huang, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.510 · Cited by 640
Deep visual tracking: Review and experimental comparison
Li, P., Wang, D., Wang, L., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.007 · Cited by 517
Self-citationNeed for Speed: A Benchmark for Higher Frame Rate Object Tracking
Galoogahi, H. K., Fagg, A., Huang, C., Ramanan, D., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.128 · Cited by 522
Metadata
- Authors
- Wang, L., Ouyang, W., Wang, X., & Lu, H.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 1373-1381
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2470456807
- Cited by
- 258
- References
- 43
- FWCI
- 20.79
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
