The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
STMTrack: Template-free Visual Tracking with Space-time Memory Networks
Abstract
Boosting performance of the offline trained siamese trackers is getting harder nowadays since the fixed information of the template cropped from the first frame has been almost thoroughly mined, but they are poorly capable of resisting target appearance changes. Existing trackers with template updating mechanisms rely on time-consuming numerical optimization and complex hand-designed strategies to achieve competitive performance, hindering them from real-time tracking and practical applications. In this paper, we propose a novel tracking framework built on top of a space-time memory network that is competent to make full use of historical information related to the target for better adapting to appearance variations during tracking. Specifically, a novel memory mechanism is introduced, which stores the historical information of the target to guide the tracker to focus on the most informative regions in the current frame. Furthermore, the pixel-level similarity computation of the memory network enables our tracker to generate much more accurate bounding boxes of the target. Extensive experiments and comparisons with many competitive trackers on challenging large-scale benchmarks, OTB-2015, TrackingNet, GOT-10k, LaSOT, UAV123, and VOT2018, show that, without bells and whistles, our tracker outperforms all previous state-of-the-art real-time methods while running at 37 FPS. The code is available at https: //github.com/fzh0917/STMTrack.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
FCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
Fully-Convolutional Siamese Networks for Object Tracking
Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546 · cited 2×
“Siamese networks [5, 60, 8] have attracted significant attention in recent years and been very popular in the tracking community [1, 65, 61, 14, 50, 6, 24, 23, 56, 15] .”
BackgroundMethodLearning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371
High Performance Visual Tracking with Siamese Region Proposal Network
Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00935 · Cited by 3,023
SiamRPN++: Evolution of Siamese Visual Tracking With Very Deep Networks
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., & Yan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00441 · Cited by 2,607
Signature Verification Using A "Siamese" Time Delay Neural Network
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000339 · Cited by 2,077
A Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809
LaSOT: A High-Quality Benchmark for Large-Scale Single Object Tracking
Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Bai, H., Xu, Y., Liao, C., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00552 · Cited by 1,742
ATOM: Accurate Tracking by Overlap Maximization
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00479 · Cited by 1,591
Fast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554 · cited 2×
“Siamese networks [5, 60, 8] have attracted significant attention in recent years and been very popular in the tracking community [1, 65, 61, 14, 50, 6, 24, 23, 56, 15] .”
BackgroundMethodLearning Discriminative Model Prediction for Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00628 · Cited by 1,515
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
Distractor-Aware Siamese Networks for Visual Object Tracking
Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., & Hu, W. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_7 · Cited by 1,501
TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192
Deeper and Wider Siamese Networks for Real-Time Visual Tracking
Zhang, Z., & Peng, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00472 · Cited by 1,160
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
Siamese Box Adaptive Network for Visual Tracking
Chen, Z., Zhong, B., Li, G., Zhang, S., & Ji, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00670 · Cited by 1,052
(2016) · doi:10.18653/v1/d16-1147 · Cited by 1,035
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., & Socher, R. (2015) · arXiv · doi:10.48550/arxiv.1506.07285 · Cited by 1,020
SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Tracking
Guo, D., Wang, J., Cui, Y., Wang, Z., & Chen, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00630 · Cited by 984
SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelines
Xu, Y., Wang, Z., Li, Z., Yuan, Y., & Yu, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6944 · Cited by 974
Ocean: Object-Aware Anchor-Free Tracking
Zhang, Z., Peng, H., Fu, J., Li, B., & Hu, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_46 · Cited by 894
Learning Dynamic Siamese Network for Visual Object Tracking
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 869
Probabilistic Regression for Visual Tracking
Danelljan, M., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00721 · Cited by 798
Video Object Segmentation Using Space-Time Memory Networks
Oh, S. W., Lee, J.-Y., Xu, N., & Kim, S. J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00932 · Cited by 745
The Sixth Visual Object Tracking VOT2018 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Zajc, L. Č., Vojír̃, T., Bhat, G., Lukežič, A., Eldesokey, A., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11009-3_1 · Cited by 655
Unveiling the Power of Deep Tracking
Bhat, G., Johnander, J., Danelljan, M., Khan, F. S., & Felsberg, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_30 · Cited by 514
Deformable Siamese Attention Networks for Visual Object Tracking
Yu, Y., Xiong, Y., Huang, W., & Scott, M. R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00676 · Cited by 495
Multi-cue Correlation Filters for Robust Visual Tracking
Wang, N., Zhou, W., Tian, Q., Hong, R., Wang, M., & Li, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00509 · Cited by 470
Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
Fan, H., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00814 · Cited by 458
Visual Tracking via Adaptive Spatially-Regularized Correlation Filters
Dai, K., Wang, D., Lu, H., Sun, C., & Li, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00480 · Cited by 434
Learning Dynamic Memory Networks for Object Tracking
Yang, T., & Chan, A. B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_10 · Cited by 382
Know Your Surroundings: Exploiting Scene Information for Object Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_13 · Cited by 362
GradNet: Gradient-Guided Network for Visual Object Tracking
Li, P., Chen, B., Ouyang, W., Wang, D., Yang, X., & Lu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00626 · Cited by 348
D3S – A Discriminative Single Shot Segmentation Tracker
Lukezic, A., Matas, J., & Kristan, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00716 · Cited by 300
GlobalTrack: A Simple and Strong Baseline for Long-Term Tracking
Huang, L., Zhao, X., & Huang, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6758 · Cited by 279
SPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking
Wang, G., Luo, C., Xiong, Z., & Zeng, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00376 · Cited by 263
Video Object Segmentation with Episodic Graph Memory Networks
Lu, X., Wang, W., Danelljan, M., Zhou, T., Shen, J., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_39 · Cited by 263
The Eighth Visual Object Tracking VOT2020 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Kämäräinen, J.-K., Danelljan, M., Zajc, L. Č., Lukežič, A., Drbohlav, O., et al. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68238-5_39 · Cited by 259
Self-citationAlpha-refine: Boosting tracking performance by precise bounding box estimation
Yan, B., Zhang, X., Wang, D., Lu, H., & Yang, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00525 · Cited by 246
Joint Group Feature Selection and Discriminative Filter Learning for Robust Visual Object Tracking
Xu, T., Feng, Z.-H., Wu, X.-J., & Kittler, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00804 · Cited by 222
Tracking by Instance Detection: A Meta-Learning Approach
Wang, G., Luo, C., Sun, X., Xiong, Z., & Zeng, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00632 · Cited by 206
Correlation Tracking via Joint Discrimination and Reliability Learning
Sun, C., Wang, D., Lu, H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00058 · Cited by 189
Correlation-Guided Attention for Corner Detection Based Visual Tracking
Du, F., Liu, P., Zhao, W., & Tang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00687 · Cited by 159
On-Road Pedestrian Tracking Across Multiple Driving Recorders
Lee, K.-H., & Hwang, J. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2455418 · Cited by 140
Deep Meta Learning for Real-Time Target-Aware Visual Tracking
Choi, J., Kwon, J., & Lee, K. M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00100 · Cited by 131
Hand Posture Recognition Using Finger Geometric Feature
Liu, L., Xing, J., Ai, H., & Ruan, X. (2014) · Cited by 117
Learning Feature Embeddings for Discriminant Model Based Tracking
Zheng, L., Tang, M., Chen, Y., Wang, J., & Lu, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_45 · Cited by 114
PG-Net: Pixel to Global Matching Network for Visual Tracking
Liao, B., Wang, C., Wang, Y., Wang, Y., & Yin, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_26 · Cited by 109
Self-citationROI Pooled Correlation Filters for Visual Tracking
Sun, Y., Sun, C., Wang, D., He, Y., & Lu, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00593 · Cited by 108
RPT: Learning Point Set Representation for Siamese Visual Tracking
Ma, Z., Wang, L., Zhang, H., Lu, W. B., & Yin, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-68238-5_43 · Cited by 92
Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning
Xing, J., Ai, H., & Lao, S. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.420 · Cited by 77
Discriminative and Robust Online Learning for Siamese Visual Tracking
Zhou, J., Wang, P., & Sun, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7002 · Cited by 75
Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box EstimationPreprint
Yan, B., Wang, D., Lu, H., & Yang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02024 · Cited by 19
Cited by
MixFormer: End-to-End Tracking with Iterative Mixed Attention
Cui, Y., Jiang, C., Wang, L., & Wu, G. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01324 · Cited by 838
Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework
Ye, B., Chang, H., Ma, B., Shan, S., & Chen, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_20 · Cited by 808
Transforming Model Prediction for Tracking
Mayer, C., Danelljan, M., Bhat, G., Paul, M., Paudel, D. P., Yu, F., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00853 · Cited by 434
Learning Target Candidate Association to Keep Track of What Not to Track
Mayer, C., Danelljan, M., Pani Paudel, D., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01319 · Cited by 376
AiATrack: Attention in Attention for Transformer Visual Tracking
Gao, S., Zhou, C., Ma, C., Wang, X., & Yuan, J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_9 · Cited by 351
Metadata
- Authors
- Fu, Z., Liu, Q., Fu, Z., & Wang, Y.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 13769-13778
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3174225630
- Cited by
- 359
- References
- 63
- FWCI
- 21.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.