The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Self-Supervised Deep Correlation Tracking
Open accessAbstract
The training of a feature extraction network typically requires abundant manually annotated training samples, making this a time-consuming and costly process. Accordingly, we propose an effective self-supervised learning-based tracker in a deep correlation framework (named: self-SDCT). Motivated by the forward-backward tracking consistency of a robust tracker, we propose a multi-cycle consistency loss as self-supervised information for learning feature extraction network from adjacent video frames. At the training stage, we generate pseudo-labels of consecutive video frames by forward-backward prediction under a Siamese correlation tracking framework and utilize the proposed multi-cycle consistency loss to learn a feature extraction network. Furthermore, we propose a similarity dropout strategy to enable some low-quality training sample pairs to be dropped and also adopt a cycle trajectory consistency loss in each sample pair to improve the training loss function. At the tracking stage, we employ the pre-trained feature extraction network to extract features and utilize a Siamese correlation tracking framework to locate the target using forward tracking alone. Extensive experimental results indicate that the proposed self-supervised deep correlation tracker (self-SDCT) achieves competitive tracking performance contrasted to state-of-the-art supervised and unsupervised tracking methods on standard evaluation benchmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Fully-Convolutional Siamese Networks for Object Tracking
Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · cited 6×
“In order to verify the proposed self-SDCT tracker, we made some experimental comparisons between our tracker and some state-of-the-art trackers on standard benchmark datasets including OTB-100 [19], UAVDT [20], TColor-128 [21], and UAV-123 [22].”
MethodInfluentialKalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
High Performance Visual Tracking with Siamese Region Proposal Network
Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00935 · Cited by 3,023
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
ECO: Efficient Convolution Operators for Tracking
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.733 · Cited by 2,805
A Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
Danelljan, M., Robinson, A., Shahbaz Khan, F., & Felsberg, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_29 · Cited by 1,853
Learning Spatially Regularized Correlation Filters for Visual Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.490 · Cited by 1,815
Staple: Complementary Learners for Real-Time Tracking
Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., & Torr, P. H. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.156 · Cited by 1,776
ATOM: Accurate Tracking by Overlap Maximization
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00479 · Cited by 1,591
Distractor-Aware Siamese Networks for Visual Object Tracking
Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., & Hu, W. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_7 · Cited by 1,501
Discriminative Scale Space Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2609928 · Cited by 1,315
Learning Background-Aware Correlation Filters for Visual Tracking
Galoogahi, H. K., Fagg, A., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.129 · Cited by 1,211
Siamese Instance Search for Tracking
Tao, R., Gavves, E., & Smeulders, A. W. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.158 · Cited by 1,208
MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization
Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,117
The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., & Tian, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_23 · Cited by 1,099
Convolutional Features for Correlation Filter Based Visual Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.84 · Cited by 975
Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking
Li, F., Tian, C., Zuo, W., Zhang, L., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00515 · Cited by 935
Learning Dynamic Siamese Network for Visual Object Tracking
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 869
Encoding Color Information for Visual Tracking: Algorithms and Benchmark
Liang, P., Blasch, E., & Ling, H. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2482905 · Cited by 726
Qi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.466 · Cited by 705
Attention-guided CNN for image denoising
Tian, C., Xu, Y., Li, Z., Zuo, W., Fei, L., & Liu, H. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.12.024 · Cited by 688
Triplet Loss in Siamese Network for Object Tracking
Dong, X., & Shen, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_28 · Cited by 648
MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking
Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., & Tao, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298675 · Cited by 644
VITAL: VIsual Tracking via Adversarial Learning
Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R. W. H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00937 · Cited by 577
CREST: Convolutional Residual Learning for Visual Tracking
Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.279 · Cited by 562
Time-Contrastive Networks: Self-Supervised Learning from Video
Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Schaal, S., Levine, S., & Brain, G. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462891 · Cited by 546
Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
Fan, H., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00814 · Cited by 458
Li, X., Ma, C., Wu, B., He, Z., & Yang, M.-H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00146 · Cited by 450
Self-citationLearning Correspondence From the Cycle-Consistency of Time
Wang, X., Jabri, A., & Efros, A. A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00267 · Cited by 445
Learning Features by Watching Objects Move
Pathak, D., Girshick, R., Dollar, P., Darrell, T., & Hariharan, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.638 · Cited by 436
Luan, S., Chen, C., Zhang, B., Han, J., & Liu, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2835143 · Cited by 428
Multi-task Correlation Particle Filter for Robust Object Tracking
Zhang, T., Xu, C., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.512 · Cited by 426
Wang, N., Song, Y., Ma, C., Zhou, W., Liu, W., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00140 · Cited by 416
Learning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking
Huang, Z., Fu, C., Li, Y., Lin, F., & Lu, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00298 · Cited by 414
Tracking Emerges by Colorizing Videos
Vondrick, C., Shrivastava, A., Fathi, A., Guadarrama, S., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_24 · Cited by 379
Robust Visual Tracking via Convolutional Networks without Training
Zhang, K., Liu, Q., Wu, Y., & Yang, M.-H. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2531283 · Cited by 343
Self-citationParallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
Fan, H., & Ling, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.585 · Cited by 329
Semantic Pooling for Complex Event Analysis in Untrimmed Videos
Chang, X., Yu, Y.-L., Yang, Y., & Xing, E. P. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2608901 · Cited by 324
Self-citationAttentional Correlation Filter Network for Adaptive Visual Tracking
Choi, J., Chang, H. J., Yun, S., Fischer, T., Demiris, Y., & Choi, J. Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.513 · Cited by 311
Structured Siamese Network for Real-Time Visual Tracking
Zhang, Y., Wang, L., Qi, J., Wang, D., Feng, M., & Lu, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_22 · Cited by 266
STCT: Sequentially Training Convolutional Networks for Visual Tracking
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.153 · Cited by 258
DCFNet: Discriminant Correlation Filters Network for Visual Tracking
Wang, Q., Gao, J. G., Xing, J., Zhang, M., & Hu, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.04057 · Cited by 258
Temporal Cycle-Consistency Learning
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00190 · Cited by 251
Coarse-to-Fine CNN for Image Super-Resolution
Tian, C., Xu, Y., Zuo, W., Zhang, B., Fei, L., & Lin, C.-W. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2999182 · Cited by 238
Context-Aware Deep Feature Compression for High-Speed Visual Tracking
Choi, J., Chang, H. J., Fischer, T., Yun, S., Lee, K., Jeong, J., Demiris, Y., & Choi, J. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00057 · Cited by 229
Robust Object Tracking via Key Patch Sparse Representation
He, Z., Yi, S., Cheung, Y.-M., You, X., & Tang, Y. Y. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2514714 · Cited by 207
Self-citationMeta-tracker: Fast and Robust Online Adaptation for Visual Object Trackers
Park, E., & Berg, A. C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_35 · Cited by 184
MAST: A Memory-Augmented Self-Supervised Tracker
Lai, Z., Lu, E., & Xie, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00651 · Cited by 170
Transitive Invariance for Self-Supervised Visual Representation Learning
Wang, X., He, K., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.149 · Cited by 168
Li, H., Li, Y., & Porikli, F. (2014) · British Machine Vision Conference (BMVC) · doi:10.5244/c.28.56 · Cited by 140
Dynamic Saliency-Aware Regularization for Correlation Filter-Based Object Tracking
Feng, W., Han, R., Guo, Q., Zhu, J., & Wang, S. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2895411 · Cited by 140
Local Semantic Siamese Networks for Fast Tracking
Liang, Z., & Shen, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959256 · Cited by 131
Correlation Particle Filter for Visual Tracking
Zhang, T., Liu, S., Xu, C., Liu, B., & Yang, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2781304 · Cited by 127
Deep Meta Learning for Real-Time Target-Aware Visual Tracking
Choi, J., Kwon, J., & Lee, K. M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00100 · Cited by 121
Unity Style Transfer for Person Re-Identification
Liu, C., Chang, X., & Shen, Y.-D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00692 · Cited by 99
Self-citationSimple to complex cross-modal learning to rank
Luo, M., Chang, X., Li, Z., Nie, L., Hauptmann, A. G., & Zheng, Q. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.07.001 · Cited by 79
Self-citationMulti-Task Driven Feature Models for Thermal Infrared Tracking
Liu, Q., Li, X., He, Z., Fan, N., Yuan, D., Liu, W., & Liang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6828 · Cited by 79
Self-citationVisual object tracking with adaptive structural convolutional network
Yuan, D., Li, X., He, Z., Liu, Q., & Lu, S. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105554 · Cited by 71
Self-citationRobust Visual Tracking Revisited: From Correlation Filter to Template Matching
Liu, F., Gong, C., Huang, X., Zhou, T., Yang, J., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2813161 · Cited by 70
Real-Time Scalable Visual Tracking via Quadrangle Kernelized Correlation Filters
Ding, G., Chen, W., Zhao, S., Han, J., & Liu, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2774778 · Cited by 54
Self-citationMultihypothesis trajectory analysis for robust visual tracking
Lee, D.-Y., Sim, J.-Y., & Kim, C. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299144 · Cited by 50
Latent Constrained Correlation Filter
Zhang, B., Luan, S., Chen, C., Han, J., Wang, W., Perina, A., & Shao, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2775060 · Cited by 50
DP-Siam: Dynamic Policy Siamese Network for Robust Object Tracking
Abdelpakey, M. H., & Shehata, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2942506 · Cited by 43
Yuan, D., Shu, X., & He, Z. (2020) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.102882 · Cited by 40
Self-citationSITUP: Scale Invariant Tracking Using Average Peak-to-Correlation Energy
Ma, H., Acton, S. T., & Lin, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2962694 · Cited by 39
A novel adaptive kernel correlation filter tracker with multiple feature integration
Liu, Z., Lian, Z., & Li, Y. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296747 · Cited by 30
Visual Object Tracking Via Multi-Stream Deep Similarity Learning Networks
Li, K., Kong, Y., & Fu, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959249 · Cited by 21
Annotation Efficient Cross-Modal Retrieval with Adversarial Attentive Alignment
Huang, P.-Y., Kang, G., Liu, W., Chang, X., & Hauptmann, A. G. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350894 · Cited by 18
Self-citation
Cited by
Self-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 317
Self-Supervised Learning for Multimedia Recommendation
Tao, Z., Liu, X., Xia, Y., Wang, X., Yang, L., Huang, X., & Chua, T.-S. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3187556 · Cited by 259
A Label Efficient Semi Self-Supervised Learning Framework for IoT Devices in Industrial Process
Bharti, V., Kumar, A., Purohit, V., Singh, R., Singh, A. K., & Singh, S. K. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3289184 · Cited by 15
Metadata
- Authors
- Yuan, D., Chang, X., Huang, P.-Y., Liu, Q., & He, Z.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2021
- Volume
- 30
- Pages
- 976-985
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3109466111
- Cited by
- 283
- References
- 73
- FWCI
- 19.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.