SITUP: Scale Invariant Tracking Using Average Peak-to-Correlation Energy
Open accessThe DOI matches its Crossref record; 47 of the 49 references it cites were found in a registry or an index.
Abstract
Robust and accurate scale estimation of a target object is a challenging task in visual object tracking. Most existing tracking methods cannot accommodate large scale variation in complex image sequences and thus result in inferior performance. In this paper, we propose to incorporate a novel criterion called the average peak-to-correlation energy into the multi-resolution translation filter framework to obtain robust and accurate scale estimation. The resulting system is named SITUP: Scale Invariant Tracking using Average Peak-to-Correlation Energy. SITUP effectively tackles the problem of fixed template size in standard discriminative correlation filter based trackers. Extensive empirical evaluation on the publicly available tracking benchmark datasets demonstrates that the proposed scale searching framework meets the demands of scale variation challenges effectively while providing superior performance over other scale adaptive variants of standard discriminative correlation filter based trackers. Also, SITUP obtains favorable performance compared to state-of-the-art trackers for various scenarios while operating in real-time on a single CPU.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Scale-invariant feature transform is proposed in [6]. It uses average peak correlation energy to update the scale of the target model.”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Another measure, i.e., average peak correlation energy (APCE), is presented in [6] given Equation (5).”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Visual object tracking using adaptive correlation filters
Bolme, D., Beveridge, J. R., Draper, B. A., & Lui, Y. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539960 · Cited by 3,406
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Incremental Learning for Robust Visual Tracking
Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061 · cited 2×
“Examples of generative tracking algorithms are found in [7], [8] and [44].”
BackgroundEdge Boxes: Locating Object Proposals from Edges
Zitnick, C. L., & Dollár, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_26 · Cited by 2,656
Exploiting the Circulant Structure of Tracking-by-Detection with Kernels
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_50 · Cited by 2,310 · cited 7×
“Typically, VOT methods work by building a target appearance model from the observed image information by way of a generative [7][8][45] or a discriminative model [14][15][26].”
BackgroundMethodInfluentialAccurate Scale Estimation for Robust Visual Tracking
Danelljan, M., Häger, G., Shahbaz Khan, F., & Felsberg, M. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.65 · Cited by 2,087
Staple: Complementary Learners for Real-Time Tracking
Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., & Torr, P. H. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.156 · Cited by 1,776
Adaptive Color Attributes for Real-Time Visual Tracking
Danelljan, M., Khan, F. S., Felsberg, M., & Van De Weijer, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.143 · Cited by 1,500
A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration
Li, Y., & Zhu, J. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_18 · Cited by 1,396
Discriminative Scale Space Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2609928 · Cited by 1,315
MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization
Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,117
Struck: Structured Output Tracking with Kernels
Hare, S., Golodetz, S., Saffari, A., Vineet, V., Cheng, M.-M., Hicks, S. L., & Torr, P. H. S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2509974 · Cited by 994
Robust online appearance models for visual tracking
Jepson, A. D., Fleet, D. J., & El-Maraghi, T. F. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1233903 · Cited by 922
Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention
Itti, L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834657 · Cited by 759
Toeplitz and Circulant Matrices: A Review
Gray, R. M. (2005) · now publishers, Inc. eBooks · doi:10.1561/9781933019680 · Cited by 759
Encoding Color Information for Visual Tracking: Algorithms and Benchmark
Liang, P., Blasch, E., & Ling, H. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2482905 · Cited by 726 · cited 2×
“For a broad understanding of the role color information can play in visual object tracking, a set of 128 color sequences with ground truth bounding boxes and challenge factor annotations are generated and named as TC128 [22].”
BackgroundMethodQi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.466 · Cited by 705
Visual tracking and recognition using appearance-adaptive models in particle filters
Zhou, S. K., Chellappa, R., & Moghaddam, B. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.836152 · Cited by 668 · cited 1×
“Examples of generative tracking algorithms are found in [7], [8] and [44].”
BackgroundLarge Margin Object Tracking with Circulant Feature Maps
Wang, M., Liu, Y., & Huang, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.510 · Cited by 640
The Visual Object Tracking VOT2014 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Čehovin, L., Nebehay, G., Vojíř, T., Fernández, G., Lukežič, A., Dimitriev, A., et al. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_14 · Cited by 588
Transfer Learning Based Visual Tracking with Gaussian Processes Regression
Gao, J., Ling, H., Hu, W., & Xing, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_13 · Cited by 449
3D Traffic Scene Understanding From Movable Platforms
Geiger, A., Lauer, M., Wojek, C., Stiller, C., & Urtasun, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.185 · Cited by 397
In defense of color-based model-free tracking
Possegger, H., Mauthner, T., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298823 · Cited by 370
Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches
Li, Y., Zhu, J., & Hoi, S. C. H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298632 · Cited by 356
Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking
Hampapur, A., Brown, L., Connell, J., Ekin, A., Haas, N., Lu, M., Merkl, H., & Pankanti, S. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1406476 · Cited by 318
Robust Visual Tracking using 1 Minimization
Mei, X., & Ling, H. (2009) · Cited by 301
End-to-End Representation Learning for Correlation Filter Based Tracking
Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., & Torr, P. H. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.531 · Cited by 274
Color attributes for object detection
Shahbaz Khan, F., Anwer, R. M., van de Weijer, J., Bagdanov, A. D., Vanrell, M., & Lopez, A. M. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248068 · Cited by 264
Robust online appearance models for visual tracking
Jepson, A. D., Fleet, D. J., & El-Maraghi, T. R. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990505 · Cited by 248
Tracking leukocytes in vivo with shape and size constrained active contours
Ray, N., Acton, S. T., & Ley, K. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.806291 · Cited by 220
Self-citationLevel Set Analysis for Leukocyte Detection and Tracking
Mukherjee, D. P., Ray, N., & Acton, S. T. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819858 · Cited by 209
Self-citationAdaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking
Ma, C., Huang, J.-B., Yang, X., & Yang, M.-H. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1076-4 · Cited by 156 · cited 1×
“• Trackers which are designed for long-term tracking by employing both short-term tracker and online classifier, including LCT+ [39] and TLD [11].”
BackgroundModulating Shape Features by Color Attention for Object Recognition
Khan, F. S., van de Weijer, J., & Vanrell, M. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0495-2 · Cited by 136
Coloring Action Recognition in Still Images
Khan, F. S., Anwer, R. M., van de Weijer, J., Bagdanov, A. D., López, A. M., & Felsberg, M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0633-0 · Cited by 124
Scalable Kernel Correlation Filter with Sparse Feature Integration
Montero, A. S., Lang, J., & Laganière, R. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.80 · Cited by 97
Enable Scale and Aspect Ratio Adaptability in Visual Tracking with Detection Proposals
Huang, D., Luo, L., Wen, M., Chen, Z., & Zhang, C. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.185 · Cited by 73
Persistent Tracking for Wide Area Aerial Surveillance
Prokaj, J., & Medioni, G. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.155 · Cited by 62
A Monte Carlo approach to rolling leukocyte tracking in vivo
Cui, J., Acton, S. T., & Lin, Z. (2006) · Medical Image Analysis · doi:10.1016/j.media.2006.05.006 · Cited by 40
Self-citationRobust visual tracking using joint scale-spatial correlation filters
Zhang, M., Xing, J., Gao, J., & Hu, W. (2015) · 2015 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2015.7351044 · Cited by 38
A Low-Level Active Vision Framework for Collaborative Unmanned Aircraft Systems
Danelljan, M., Khan, F. S., Felsberg, M., Granström, K., Heintz, F., Rudol, P., Wzorek, M., Kvarnström, J., & Doherty, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16178-5_15 · Cited by 20
A grid-based Bayesian approach to robust visual tracking
Liu, X., Lin, Z., & Acton, S. T. (2011) · Digital Signal Processing · doi:10.1016/j.dsp.2011.08.003 · Cited by 16
Self-citationDetecting occlusion from color information to improve visual tracking
Siena, S., & Kumar, B. V. K. V. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7471848 · Cited by 8
Research works printed but not linked: 1
- 10.1561/0100000006 · DOI · Paper page
Cited by
Self-Supervised Deep Correlation Tracking
Yuan, D., Chang, X., Huang, P.-Y., Liu, Q., & He, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3037518 · Cited by 283
Multi-Regularized Correlation Filter for UAV Tracking and Self-Localization
Ye, J., Fu, C., Lin, F., Ding, F., An, S., & Lu, G. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3088366 · Cited by 96
Motion-Aware Correlation Filter-Based Object Tracking in Satellite Videos
Lin, B., Zheng, J., Xue, C., Fu, L., Li, Y., & Shen, Q. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3350988 · Cited by 74
Visual tracking via dynamic saliency discriminative correlation filter
Gao, L., Liu, B., Fu, P., Xu, M., & Li, J. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02260-2 · Cited by 32
Channel Graph Regularized Correlation Filters for Visual Object Tracking
Jain, M., Tyagi, A., Subramanyam, A. V., Denman, S., Sridharan, S., & Fookes, C. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3063144 · Cited by 27
Metadata
- Authors
- Ma, H., Acton, S. T., & Lin, Z.
- Affiliations
- University of Virginia (US)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 3546-3557
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3000728514
- Cited by
- 39
- References
- 49
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 2 · 2023: 6 · 2022: 9 · 2021: 10 · 2020: 4
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Army Research Office (W911NF-15-1-0275)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- visual object tracking, scale estimation, scale invariance, discriminative correlation filter, scale variation, template size, real-time tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.