Cited by 1,742Video Surveillance and Tracking MethodsAdvanced Neural Network ApplicationsAutonomous Vehicle Technology and Safety

LaSOT: A High-Quality Benchmark for Large-Scale Single Object Tracking

Open access
Fan, Heng, Lin, Liting, Yang, Fan, Chu, Peng, Deng, Ge, Yu, Sijia, Bai, Hexin, Xu, Yong +2 more·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

In this paper, we present LaSOT, a high-quality benchmark for Large-scale Single Object Tracking. LaSOT consists of 1,400 sequences with more than 3.5M frames in total. Each frame in these sequences is carefully and manually annotated with a bounding box, making LaSOT the largest, to the best of our knowledge, densely annotated tracking benchmark. The average video length of LaSOT is more than 2,500 frames, and each sequence comprises various challenges deriving from the wild where target objects may disappear and re-appear again in the view. By releasing LaSOT, we expect to provide the community with a large-scale dedicated benchmark with high quality for both the training of deep trackers and the veritable evaluation of tracking algorithms. Moreover, considering the close connections of visual appearance and natural language, we enrich LaSOT by providing additional language specification, aiming at encouraging the exploration of natural linguistic feature for tracking. A thorough experimental evaluation of 35 tracking algorithms on LaSOT is presented with detailed analysis, and the results demonstrate that there is still a big room for improvements.

Integrity signals

Registry

Crossref · 10.1109/cvpr.2019.00552

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

  • Deep Residual Learning for Image Recognition

    He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1× · see citing works

    “, [46] and [18]) from image classification for deep feature extraction or the sequences from video object detection (e.”
    Background
  • Very Deep Convolutional Networks for Large-Scale Image Recognition

    Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · cited 1× · see citing works

    “, [46] and [18]) from image classification for deep feature extraction or the sequences from video object detection (e.”
    Background
  • ImageNet: A large-scale hierarchical image database

    Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 4× · see citing works

    “Most of 70 classes are chosen form the 1,000 classes in ImageNet [12], with a few exceptions such as drone and gametarget , which are carefully selected by the experts for tracking.”
    BackgroundInfluential
  • ImageNet Large Scale Visual Recognition Challenge

    Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2× · see citing works

    “, [45] and [43]) for deep feature learning, which may result in suboptimal tracking performance because of the intrinsic differences among different tasks [55].”
    BackgroundResult
  • How transferable are features in deep neural networks?

    Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1× · see citing works

    “, [45] and [43]) for deep feature learning, which may result in suboptimal tracking performance because of the intrinsic differences among different tasks [55].”
    Background
  • High-Speed Tracking with Kernelized Correlation Filters

    Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753 · see citing works

  • Object tracking

    Yılmaz, A., Javed, O., & Shah, M. A. (2006) · ACM Computing Surveys · doi:10.1145/1177352.1177355 · Cited by 4,807 · cited 2× · see citing works

    “In this section, we mainly focus on the tracking benchmarks that are relevant to our work, and refer the readers to surveys [32, 47, 54, 30] for tracking algorithms.”
    Background
  • Fully-Convolutional Siamese Networks for Object Tracking

    Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546 · cited 3× · see citing works

    “, MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation filter trackers with hand-crafted features (e.”
    BackgroundMethod
  • Online Object Tracking: A Benchmark

    Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138 · cited 6× · see citing works

    “Currently, the popular dense benchmarks contain OTB [52, 53], TC-128 [35], VOT [25], NUS-PRO [28], UAV [39], NfS [14] and GOT-10k [22].”
    BackgroundMethodResultInfluential
  • Object Tracking Benchmark

    Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · cited 9× · see citing works

    “Summaries of existing tracking benchmarks with highquality dense (per frame) annotations, including OTB-2013 [52], OTB-2015 [53], TC-128 [35], NUS-PRO [28], UAV123 [39], UAV20L [39], VOT-2014 [26], VOT-2017 [27] and LaSOT.”
    BackgroundMethodResultInfluential
  • Tracking-Learning-Detection

    Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,357 · cited 1× · see citing works

    “…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
    Method
  • Incremental Learning for Robust Visual Tracking

    Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061 · cited 2× · see citing works

    “We evaluate 35 algorithms on LaSOT to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20],…”
    Background
  • Learning Multi-domain Convolutional Neural Networks for Visual Tracking

    Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806 · cited 7× · see citing works

    “Both MDNet and VITAL are trained in an online fashion, resulting in expensive computation and slow running speeds.”
    BackgroundMethodInfluential
  • ECO: Efficient Convolution Operators for Tracking

    Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.733 · Cited by 2,805 · cited 4× · see citing works

    “…KCF [20] PAMI15 Staple [3] CVPR16 SINT [49] CVPR16 SCT4 [6] CVPR16 MDNet [42] CVPR16 SiamFC [4] ECCVW16 Staple CA[40] CVPR17 ECO HC [7] CVPR17 ECO [7] CVPR17 CFNet [50] CVPR17 CSRDCF[36] CVPR17 PTAV [13] ICCV17 DSiam [16] ICCV17 BACF [15] ICCV17 fDSST [9] PAMI17 VITAL [48] CVPR18 TRACA [5] CVPR18…”
    BackgroundInfluential
  • Exploiting the Circulant Structure of Tracking-by-Detection with Kernels

    Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_50 · Cited by 2,310 · cited 3× · see citing works

    “We evaluate 35 algorithms on LaSOT to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20],…”
  • Learning Spatially Regularized Correlation Filters for Visual Tracking

    Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.490 · Cited by 2,171 · cited 2× · see citing works

    “…leverage deep feature, demon-Table B CN [11] CVPR14 DSST [8] BMVC14 MEEM [56] ECCV14 STC [57] ECCV14 SAMF [33] ECCVW14 LCT [38] CVPR15 SRDCF [10] ICCV15 HCFT [37] ICCV15 KCF [20] PAMI15 Staple [3] CVPR16 SINT [49] CVPR16 SCT4 [6] CVPR16 MDNet [42] CVPR16 SiamFC [4] ECCVW16 Staple CA[40]…”
    Background
  • Accurate Scale Estimation for Robust Visual Tracking

    Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2014) · British Machine Vision Conference (BMVC) · doi:10.5244/c.28.65 · Cited by 2,145 · cited 3× · see citing works

    “, ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20], fDSST [9], SAMF [33], SCT4 [6], STC [57] and Staple [3]) or deep features (e.”
    Background
  • A Benchmark and Simulator for UAV Tracking

    Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944 · cited 9× · see citing works

    “Summaries of existing tracking benchmarks with highquality dense (per frame) annotations, including OTB-2013 [52], OTB-2015 [53], TC-128 [35], NUS-PRO [28], UAV123 [39], UAV20L [39], VOT-2014 [26], VOT-2017 [27] and LaSOT.”
    BackgroundMethodInfluential
  • Visual tracking with online Multiple Instance Learning

    Babenko, B., Yang, M., & Belongie, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206737 · Cited by 1,860 · cited 2× · see citing works

    “We evaluate 35 algorithms on LaSOT to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20],…”
    Background
  • Struck: Structured output tracking with kernels

    Hare, S., Saffari, A., & Torr, P. H. S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126251 · Cited by 1,831 · cited 1× · see citing works

    “…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
    Method
  • Staple: Complementary Learners for Real-Time Tracking

    Bertinetto, L., Valmadre, J., Golodetz, S., Mikšík, O., & Torr, P. H. S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.156 · Cited by 1,825 · cited 4× · see citing works

    “To qualitatively analyze different trackers and provide guidance for future research, we show the qualitative evaluation results of six representative trackers, including MDNet, SiamFC, ECO, PTAV, Staple and MEEM, in six typical hard challenges containing fast motion , full occlusion , low resolution , out-of-view , a…”
    BackgroundInfluential
  • Hierarchical Convolutional Features for Visual Tracking

    Ma, C., Huang, J., Yang, X., & Yang, M. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.352 · Cited by 1,811 · cited 3× · see citing works

    “, HCFT [37] and ECO [7]) and regularization techniques (e.”
    Background
  • GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild

    Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809 · cited 2× · see citing works

    “GOT-10k [22] consists of 10,000 videos, aiming to provide rich motion trajectories for developing and evaluating trackers.”
    Background
  • Adaptive Color Attributes for Real-Time Visual Tracking

    Danelljan, M., Khan, F. S., Felsberg, M., & van de Weijer, J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.143 · Cited by 1,541 · cited 2× · see citing works

    “IVT [43] IJCV08 3 3 MIL [1] CVPR09 H 3 Struck [17] ICCV11 H 3 L1APG [2] CVPR12 3 3 ASLA [22] CVPR12 3 3 CSK [19] ECCV12 3 3 CT [57] ECCV12 H 3 TLD [23] PAMI12 B 3 CN [11] CVPR14 3 3 3 DSST [8] BMVC14 3 3 3 MEEM [55] ECCV14 3 3 STC [56] ECCV14 3 3 SAMF [32] ECCVW14 3 3 3 3 LCT [37] CVPR15 3 3 3 SRDCF [10] ICCV15 3 3 HC…”
  • Visual Tracking: An Experimental Survey

    Smeulders, A. W. M., Chu, D. M., Cucchiara, R., Calderara, S., Dehghan, A., & Shah, M. A. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.230 · Cited by 1,527 · see citing works

  • A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration

    Li, Y., & Zhu, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16181-5_18 · Cited by 1,461 · cited 2× · see citing works

    “5 is that all the top seven trackers leverage deep feature, demon-Table B CN [11] CVPR14 DSST [8] BMVC14 MEEM [56] ECCV14 STC [57] ECCV14 SAMF [33] ECCVW14 LCT [38] CVPR15 SRDCF [10] ICCV15 HCFT [37] ICCV15 KCF [20] PAMI15 Staple [3] CVPR16 SINT [49] CVPR16 SCT4 [6] CVPR16 MDNet [42] CVPR16 SiamFC…”
    Background
  • Real-Time Compressive Tracking

    Zhang, K., Lei Zhang, A., & Yang, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_62 · Cited by 1,442 · cited 1× · see citing works

    “…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
    Method
  • Discriminative Scale Space Tracking

    Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2609928 · Cited by 1,315 · cited 1× · see citing works

    “, ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20], fDSST [9], SAMF [33], SCT4 [6], STC [57] and Staple [3]) or deep features (e.”
    Background
  • Learning Background-Aware Correlation Filters for Visual Tracking

    Galoogahi, H. K., Fagg, A., & Lucey, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.129 · Cited by 1,270 · cited 2× · see citing works

    “…[9], SAMF [33], SCT4 [6], STC [57] and Staple [3]) or deep features ( e.g ., HCFT [37] and ECO [7]) and regularization techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse…”
    Background
  • Siamese Instance Search for Tracking

    Tao, R., Gavves, E., & Smeulders, A. W. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.158 · Cited by 1,208 · cited 2× · see citing works

    “…to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20], fDSST [9],…”
    Background
  • Visual tracking via adaptive structural local sparse appearance model

    Jia, X., Lu, H., & Yang, M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247880 · Cited by 1,200 · cited 1× · see citing works

    “…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
    Method
  • TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild

    Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192 · cited 6× · see citing works

    “In the literature, many datasets have been proposed to deal with the issues above: e.g ., [39, 51] for long-term tracking, [41] for large-scale, [52, 35, 25] for precise dense annotations.”
    BackgroundMethodInfluential
  • Discriminative Correlation Filter with Channel and Spatial Reliability

    Lukezic, A., Vojir, T., Zajc, L. C., Matas, J., & Kristan, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.515 · Cited by 1,153 · see citing works

  • MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization

    Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,150 · cited 2× · see citing works

    “5 is that all the top seven trackers leverage deep feature, demon-Table B CN [11] CVPR14 DSST [8] BMVC14 MEEM [56] ECCV14 STC [57] ECCV14 SAMF [33] ECCVW14 LCT [38] CVPR15 SRDCF [10] ICCV15 HCFT [37] ICCV15 KCF [20] PAMI15 Staple [3] CVPR16 SINT [49] CVPR16 SCT4 [6] CVPR16 MDNet [42] CVPR16 SiamFC…”
    BackgroundMethod
  • Long-term correlation tracking

    Ma, C., Yang, X., Zhang, C., & Yang, M. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299177 · Cited by 980 · cited 3× · see citing works

    “, PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers (e.”
    Background
  • Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking

    Li, F., Tian, C., Zuo, W., Zhang, L., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00515 · Cited by 935 · cited 2× · see citing works

    “…deep features ( e.g ., HCFT [37] and ECO [7]) and regularization techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other…”
    Background
  • Learning Dynamic Siamese Network for Visual Object Tracking

    Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 904 · cited 3× · see citing works

    “, MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation filter trackers with hand-crafted features (e.”
    Background
  • The Visual Object Tracking VOT2015 Challenge Results

    Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Zajc, L. Č., Vojír, T., Häger, G., Lukežič, A., Eldesokey, A., et al. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.79 · Cited by 895 · see citing works

  • Real time robust L1 tracker using accelerated proximal gradient approach

    Bao, C., Wu, Y., Ling, H., & Ji, H. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247881 · Cited by 839 · cited 1× · see citing works

    “…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
    MethodSelf-citation
  • Encoding Color Information for Visual Tracking: Algorithms and Benchmark

    Liang, P., Blasch, E., & Ling, H. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2482905 · Cited by 726 · cited 6× · see citing works

    “Currently, the popular dense benchmarks contain OTB [52, 53], TC-128 [35], VOT [25], NUS-PRO [28], UAV [39], NfS [14] and GOT-10k [22].”
    BackgroundInfluentialSelf-citation
  • A survey of appearance models in visual object tracking

    Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705 · cited 2× · see citing works

    “In this section, we mainly focus on the tracking benchmarks that are relevant to our work, and refer the readers to surveys [32, 47, 54, 30] for tracking algorithms.”
    Background
  • Fast Visual Tracking via Dense Spatio-temporal Context Learning

    Zhang, K., Lei Zhang, A., Liu, Q., Zhang, D. D., & Yang, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10602-1_9 · Cited by 681 · cited 4× · see citing works

    “We evaluate 35 algorithms on LaSOT to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20],…”
    BackgroundInfluential
  • Context-Aware Correlation Filter Tracking

    Mueller, M. F., Smith, N., & Ghanem, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.152 · Cited by 662 · cited 3× · see citing works

    “…Staple [3]) or deep features ( e.g ., HCFT [37] and ECO [7]) and regularization techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]),…”
    Background
  • A Novel Performance Evaluation Methodology for Single-Target Trackers

    Kristan, M., Matas, J., Leonardis, A., Vojir, T., Pflugfelder, R. P., Fernandez, G., Nebehay, G., Porikli, F., & Zajc, L. Č. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2516982 · Cited by 613 · cited 6× · see citing works

    “Currently, the popular dense benchmarks contain OTB [52, 53], TC-128 [35], VOT [25], NUS-PRO [28], UAV [39], NfS [14] and GOT-10k [22].”
    BackgroundInfluential
  • The Visual Object Tracking VOT2014 Challenge Results

    Kristan, M., Pflugfelder, R. P., Leonardis, A., Matas, J., Zajc, L. Č., Nebehay, G., Vojíř, T., Fernández, G., Lukežič, A., Dimitriev, A., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16181-5_14 · Cited by 606 · cited 3× · see citing works

    “Summaries of existing tracking benchmarks with highquality dense (per frame) annotations, including OTB-2013 [52], OTB-2015 [53], TC-128 [35], NUS-PRO [28], UAV123 [39], UAV20L [39], VOT-2014 [26], VOT-2017 [27] and LaSOT.”
  • VITAL: VIsual Tracking via Adversarial Learning

    Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R. W. H., & Yang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00937 · Cited by 595 · cited 5× · see citing works

    “Both MDNet and VITAL are trained in an online fashion, resulting in expensive computation and slow running speeds.”
    BackgroundInfluential
  • YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video

    Real, E., Shlens, J., Mazzocchi, S., Pan, X., & Vanhoucke, V. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.789 · Cited by 580 · cited 3× · see citing works

    “TrackingNet [41] is a subset of the video object detection benchmark YT-BB [43] by selecting 30K videos, each of which is annotated by a tracker.”
    BackgroundMethod
  • Person Search with Natural Language Description

    Li, S., Xiao, T., Li, H., Zhou, B., Yue, D., & Wang, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.551 · Cited by 571 · cited 1× · see citing works

    “, [21, 31]) including visual tracking [34].”
  • Need for Speed: A Benchmark for Higher Frame Rate Object Tracking

    Galoogahi, H. K., Fagg, A., Huang, C., Ramanan, D., & Lucey, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.128 · Cited by 542 · cited 4× · see citing works

    “NfS [14] provides 100 sequences with a high framerate of 240 fps, aiming to analyze the effects of appearance variations on tracking performance.”
    BackgroundInfluential
  • Natural Language Object Retrieval

    Hu, R., Xu, H., Rohrbach, M., Feng, J., Saenko, K., & Darrell, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.493 · Cited by 534 · cited 1× · see citing works

    “2) Different from existing datasets, LaSOT provides both visual bounding box annotations and rich natural language specification, which has recently been proven to be beneficial for various vision tasks ( e.g ., [21, 31]) including visual tracking [34].”
    Background
  • Deep visual tracking: Review and experimental comparison

    Li, P., Wang, D., Wang, L., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.007 · Cited by 517 · cited 1× · see citing works

    “In this section, we mainly focus on the tracking benchmarks that are relevant to our work, and refer the readers to surveys [32, 47, 54, 30] for tracking algorithms.”
    Background
  • Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking

    Fan, H., & Ling, H. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.585 · Cited by 330 · cited 2× · see citing works

    “…ECO [7]) and regularization techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1]…”
    BackgroundSelf-citation
  • The Visual Object Tracking VOT2017 Challenge Results

    Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Zajc, L. Č., Vojír, T., Häger, G., Lukežič, A., Eldesokey, A., et al. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.230 · Cited by 319 · cited 3× · see citing works

    “VOT-2017 [27] 60 41 356 293 1,500 21K 11.”
  • Structured Siamese Network for Real-Time Visual Tracking

    Zhang, Y., Wang, L., Qi, J., Wang, D., Feng, M., & Lu, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_22 · Cited by 272 · cited 3× · see citing works

    “…35 algorithms on LaSOT to provide extensive baselines, comprising deep trackers ( e.g ., MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19],…”
    Background
  • Context-Aware Deep Feature Compression for High-Speed Visual Tracking

    Choi, J., Chang, H. J., Fischer, T., Yun, S., Lee, K., Jeong, J., Demiris, Y., & Choi, J. Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00057 · Cited by 238 · cited 3× · see citing works

    “, MDNet [42], TRACA [5], CFNet [50], SiamFC [4], StructSiam [59], DSiam [16], SINT [49] and VITAL [48]), correlation filter trackers with hand-crafted features (e.”
    Background
  • Visual Tracking Using Attention-Modulated Disintegration and Integration

    Choi, J., Chang, H. J., Jeong, J., Demiris, Y., & Choi, J. Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.468 · Cited by 191 · cited 2× · see citing works

    “…correlation fil-ter trackers with hand-crafted features ( e.g ., ECO HC [7], DSST [8], CN [11], CSK [19], KCF [20], fDSST [9], SAMF [33], SCT4 [6], STC [57] and Staple [3]) or deep features ( e.g ., HCFT [37] and ECO [7]) and regularization techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF…”
    Background
  • Tracking by Natural Language Specification

    Li, Z., Ran, T., Gavves, E., Snoek, C. G. M., & Smeulders, A. W. M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.777 · Cited by 184 · cited 1× · see citing works

    “2) Different from existing datasets, LaSOT provides both visual bounding box annotations and rich natural language specification, which has recently been proven to be beneficial for various vision tasks ( e.g ., [21, 31]) including visual tracking [34].”
    Background
  • NUS-PRO: A New Visual Tracking Challenge

    Li, A., Lin, M., Wu, Y., Yang, M., & Yan, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2417577 · Cited by 174 · cited 7× · see citing works

    “Summaries of existing tracking benchmarks with highquality dense (per frame) annotations, including OTB-2013 [52], OTB-2015 [53], TC-128 [35], NUS-PRO [28], UAV123 [39], UAV20L [39], VOT-2014 [26], VOT-2017 [27] and LaSOT.”
    BackgroundInfluential
  • Long-Term Tracking in the Wild: A Benchmark

    Valmadre, J., Bertinetto, L., Henriques, J. F., Ran, T., Vedaldi, A., Smeulders, A. W. M., Torr, P. H. S., & Gavves, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_41 · Cited by 157 · cited 8× · see citing works

    “Unlike TrackingNet, OxUvA is focused on long-term tracking.”
    BackgroundMethodInfluential

Flagged first, then by citations

4 of the 63 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Bai, H., Xu, Y., Liao, C., & Ling, H.
Affiliations
  • Temple University (US)
  • South China University of Technology (CN)
  • Meituan (China) (CN)
Venue
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2019-06
Pages
5369-5378
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2891033863
Cited by
1,742
References
63
Citations by year
2026: 171 · 2025: 297 · 2024: 330 · 2023: 295 · 2022: 234 · 2021: 220 · 2020: 148 · 2019: 46 · 2018: 1
FWCI
52.22
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Science Foundation (1350521, 1449860, 1618398)
  • National Natural Science Foundation of China (61672241, 2016YFB1001200, U1611461, 1449860)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
Keywords
single object tracking, tracking benchmark, LaSOT, target occlusion, tracking algorithm evaluation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review