Visual object tracking using adaptive correlation filters
The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
Although not commonly used, correlation filters can track complex objects through rotations, occlusions and other distractions at over 20 times the rate of current state-of-the-art techniques. The oldest and simplest correlation filters use simple templates and generally fail when applied to tracking. More modern approaches such as ASEF and UMACE perform better, but their training needs are poorly suited to tracking. Visual tracking requires robust filters to be trained from a single frame and dynamically adapted as the appearance of the target object changes. This paper presents a new type of correlation filter, a Minimum Output Sum of Squared Error (MOSSE) filter, which produces stable correlation filters when initialized using a single frame. A tracker based upon MOSSE filters is robust to variations in lighting, scale, pose, and nonrigid deformations while operating at 669 frames per second. Occlusion is detected based upon the peak-to-sidelobe ratio, which enables the tracker to pause and resume where it left off when the object reappears.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · cited 1×
“Motivation for averaging comes from Bootstrap Aggregation [5] where the output of weak classifiers can be averaged to produce a much stronger classifier.”
BackgroundPress, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Incremental Learning for Robust Visual Tracking
Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061 · cited 7×
“Recent examples include: Incremental Visual Tracking (IVT) [17], Robust Fragmentsbased Tracking (FragTrack) [1], Graph Based Discriminative Learning (GBDL) [19], and Multiple Instance Learning (MILTrack) [2].”
BackgroundMethodInfluentialVisual tracking with online Multiple Instance Learning
Babenko, B., Yang, M.-H., & Belongie, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206737 · Cited by 1,770 · cited 6×
“Recent examples include: Incremental Visual Tracking (IVT) [17], Robust Fragmentsbased Tracking (FragTrack) [1], Graph Based Discriminative Learning (GBDL) [19], and Multiple Instance Learning (MILTrack) [2].”
BackgroundMethodInfluentialRobust Fragments-based Tracking using the Integral Histogram
Adam, A., Rivlin, E., & Shimshoni, I. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.256 · Cited by 1,397 · cited 7×
“Recent examples include: Incremental Visual Tracking (IVT) [17], Robust Fragmentsbased Tracking (FragTrack) [1], Graph Based Discriminative Learning (GBDL) [19], and Multiple Instance Learning (MILTrack) [2].”
BackgroundMethodInfluentialRobust online appearance models for visual tracking
Jepson, A. D., Fleet, D. J., & El-Maraghi, T. F. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1233903 · Cited by 922
Minimum average correlation energy filters
Mahalanobis, A., Vijaya Kumar, B. V. K., & Casasent, D. (1987) · Applied Optics · doi:10.1364/ao.26.003633 · Cited by 598 · cited 1×
“In the 1980’s and 1990’s, many variants of correlation filters, including Synthetic Discriminant Functions (SDF) [7, 6], Minimum Variance Synthetic Discriminant Functions (MVSDF) [9], Minimum Average Correlation Energy (MACE) [11], Optimal Tradeoff Filters (OTF) [16], and Minimum Squared Error Synthetic Discriminant F…”
MethodMultivariant technique for multiclass pattern recognition
Hester, C. F., & Casasent, D. (1980) · Applied Optics · doi:10.1364/ao.19.001758 · Cited by 385 · cited 3×
“In [12], it was found that the hard constraints of SDF based filters like MACE caused issues with distortion Naive UMACE ASEF MOSSE INPUT FILTER OUTPUT Figure 2 .”
MethodUnconstrained correlation filters
Mahalanobis, A., Vijaya Kumar, B. V. K., Song, S., Sims, S. R. F., & Epperson, J. F. (1994) · Applied Optics · doi:10.1364/ao.33.003751 · Cited by 293 · cited 2×
“In fact, the optimization problem in Equation 3 is almost identical to optimization problems presented in [10] and [12].”
MethodUnified synthetic discriminant function computational formulation
Casasent, D. (1984) · Applied Optics · doi:10.1364/ao.23.001620 · Cited by 292 · cited 3×
“In [12], it was found that the hard constraints of SDF based filters like MACE caused issues with distortion Naive UMACE ASEF MOSSE INPUT FILTER OUTPUT Figure 2 .”
Method
Research works printed but not linked: 2
- messerschmitt, 2006, Stationary points of a real-valued function of a complex variable
- savvides, 2002, Face verification using correlation filters, AIAT
Cited by
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
High Performance Visual Tracking with Siamese Region Proposal Network
Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00935 · Cited by 3,023
“conducted in Fourier domain and is then widely used in the tracking community [5, 14].”
MethodLearning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
“[2] proposed a fast correlation tracker with a minimum output sum of squared error (MOSSE) filter, which runs in hundreds of frames per second.”
BackgroundECO: Efficient Convolution Operators for Tracking
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.733 · Cited by 2,805
“The standard approach in DCF based tracking is to update the model in each frame [4, 9, 20].”
BackgroundSiamRPN++: Evolution of Siamese Visual Tracking With Very Deep Networks
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., & Yan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00441 · Cited by 2,607
“[3] introduces the Convolution Theorem from the signal processing field into visual tracking and transforms the object template matching problem into a correlation operation in the frequency domain.”
MethodExploiting the Circulant Structure of Tracking-by-Detection with Kernels
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_50 · Cited by 2,310
“This is a kind of correlation filter that has been proposed recently, called Minimum Output Sum of Squared Error (MOSSE) [12, 15], with a single training image.”
BackgroundMethodInfluentialLearning Spatially Regularized Correlation Filters for Visual Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.490 · Cited by 1,815
“Samples are multiplied by a Hann window [5].”
MethodAccurate Scale Estimation for Robust Visual Tracking
Danelljan, M., Häger, G., Shahbaz Khan, F., & Felsberg, M. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.65 · Cited by 2,087
“In recent years, tracking-by-detection methods [3, 9, 11, 19] have shown to provide excellent tracking performance.”
BackgroundMethodInfluentialA Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
“SAMF [23], MUSTER [18], DSST [8], Struck [13], and ASLA [19] group into a second tier of close performing trackers, while the remaining trackers IVT [38], TLD [21], MOSSE [5], CSK [17], OAB [11], KCF [16] and DCF [16] achieve consistently lower performance.”
BackgroundFairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
Zhang, Y., Wang, C., Wang, X., Zeng, W., & Liu, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01513-4 · Cited by 1,861
“We update the appearance features of the trackers in each time step to handle appearance variations as in [53], [54].”
MethodBeyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
Danelljan, M., Robinson, A., Shahbaz Khan, F., & Felsberg, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_29 · Cited by 1,853
“However, our continuous formulation has several advantages compared to the original MOSSE.”
BackgroundMethodResultInfluentialStaple: Complementary Learners for Real-Time Tracking
Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., & Torr, P. H. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.156 · Cited by 1,776
“[5], their extension to multiple feature channels [4, 17, 22, 18] and therefore HOG features [7] enabled the technique to achieve state-of-the-art performance in VOT14 [24].”
MethodHierarchical Convolutional Features for Visual Tracking
Ma, C., Huang, J.-B., Yang, X., & Yang, M.-H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.352 · Cited by 1,776
“To remove the boundary discontinuities, the extracted feature channels of each convolutional layer are weighted by a cosine window [3].”
BackgroundMethodInfluentialGOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809
“Later on, several improvements on MOSSE have been proposed.”
MethodInfluentialFast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554
“[6].”
Adaptive Color Attributes for Real-Time Visual Tracking
Danelljan, M., Khan, F. S., Felsberg, M., & Van De Weijer, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.143 · Cited by 1,500
“Here, we generalize the update scheme of [4] to kernelized classifiers and multi-dimensional color features.”
MethodLearning Discriminative Model Prediction for Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00628 · Cited by 1,515
A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration
Li, Y., & Zhu, J. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_18 · Cited by 1,396
“Our proposed approach is closely related to the correlation filter-based trackers [14] [4] [12] [7] [6], which adopt the correlation filter in traditional signal processing technique into the tracking applications.”
BackgroundMethodInfluentialDiscriminative Scale Space Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2609928 · Cited by 1,315
Learning Background-Aware Correlation Filters for Visual Tracking
Galoogahi, H. K., Fagg, A., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.129 · Cited by 1,211
“Implementation Details: Following [10, 13, 1] we employ 31-channel HOG features [6] using 4 ⇥ 4 cells multiplied by a Hann window [3].”
BackgroundMethodInfluentialTrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192
Discriminative Correlation Filter with Channel and Spatial Reliability
Lukezic, A., Vojir, T., Zajc, L. C., Matas, J., & Kristan, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.515 · Cited by 1,153
Convolutional Features for Correlation Filter Based Visual Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.84 · Cited by 975
“As discussed in [4], the extracted features are always multiplied with a Hann window.”
BackgroundMethodInfluentialJoint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework
Ye, B., Chang, H., Ma, B., Shan, S., & Chen, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_20 · Cited by 808
SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Tracking
Guo, D., Wang, J., Cui, Y., Wang, Z., & Chen, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00630 · Cited by 984
Long-term correlation tracking
Ma, C., Yang, X., Zhang, C., & Yang, M.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299177 · Cited by 959
“Bolme et al. propose to learn a minimum output sum of squared error (MOSSE) [3] filter for visual tracking on gray-scale images, where the learned filter encodes target appearance with update on every frame.”
BackgroundMethodInfluentialSiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelines
Xu, Y., Wang, Z., Li, Z., Yuan, Y., & Yu, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6944 · Cited by 974
Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking
Li, F., Tian, C., Zuo, W., Zhang, L., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00515 · Cited by 935
Learning Dynamic Siamese Network for Visual Object Tracking
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.196 · Cited by 869
“MOSSE [3], KCF [16], STC [32], DSST [5], Staple [1].”
MethodProbabilistic Regression for Visual Tracking
Danelljan, M., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00721 · Cited by 798
Qi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.466 · Cited by 705
“[4] develop the Minimum Output Sum of Squared Error (MOSSE) method to learn the filters, and use intensity features for object representation.”
BackgroundMethodThe Visual Object Tracking VOT2016 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Čehovin, L., Vojír̃, T., Häger, G., Lukežič, A., Fernández, G., et al. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_54 · Cited by 679
“The Discriminative Scale Space Tracker (DSST) [48] extends the Minimum Output Sum of Squared Errors (MOSSE) tracker [101] with robust scale estimation.”
MethodThe Visual Object Tracking VOT2015 Challenge Results
(2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.79 · Cited by 666
“cn NSAM is based on the correlation filter framework [25, 7].”
MethodFast Visual Tracking via Dense Spatio-temporal Context Learning
Zhang, K., Zhang, L., Liu, Q., Zhang, D., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_9 · Cited by 663
“PAMI 24(4), 509–522 (2002) [4] Bolme, D.”
Large Margin Object Tracking with Circulant Feature Maps
Wang, M., Liu, Y., & Huang, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.510 · Cited by 640
“[4] introduce the CF into the visual tracking field, several extensions have been proposed to improve tracking performance.”
BackgroundThe Sixth Visual Object Tracking VOT2018 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Zajc, L. Č., Vojír̃, T., Bhat, G., Lukežič, A., Eldesokey, A., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11009-3_1 · Cited by 655
“The Discriminative Scale Space Tracker (DSST) [12] extends the Minimum Output Sum of Squared Errors (MOSSE) tracker [9] with robust scale estimation.”
MethodMUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking
Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., & Tao, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298675 · Cited by 644
“The correlation filter-based trackers [5, 6, 7, 17, 16, 31] are becoming increasingly popular due to their promising performance and computational efficiency.”
BackgroundContext-Aware Correlation Filter Tracking
Mueller, M., Smith, N., & Ghanem, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.152 · Cited by 636
“[4], correlation filters (CF) have been studied as a robust and efficient approach to the problem of visual tracking.”
BackgroundA Novel Performance Evaluation Methodology for Single-Target Trackers
Kristan, M., Matas, J., Leonardis, A., Vojir, T., Pflugfelder, R., Fernandez, G., Nebehay, G., Porikli, F., & Cehovin, L. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2516982 · Cited by 613
The Visual Object Tracking VOT2014 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Čehovin, L., Nebehay, G., Vojíř, T., Fernández, G., Lukežič, A., Dimitriev, A., et al. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16181-5_14 · Cited by 588
“The MOSSE tracker works by training a discriminative correlation filter on a set of observed sample grey scale patches.”
InfluentialWang, Q., Teng, Z., Xing, J., Gao, J., Hu, W., & Maybank, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00510 · Cited by 604
“One of the most successful tracking frameworks is Correlation Filter (CF) [3,8,22,27,33,54,55].”
BackgroundVITAL: VIsual Tracking via Adversarial Learning
Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R. W. H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00937 · Cited by 577
Detect to Track and Track to Detect
Feichtenhofer, C., Pinz, A., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.330 · Cited by 595
“A tracking representation that is based on correlation filters [2, 4, 14] can exploit the translational equivariance as correlation is equivariant to translation.”
CREST: Convolutional Residual Learning for Visual Tracking
Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.279 · Cited by 562
Need for Speed: A Benchmark for Higher Frame Rate Object Tracking
Galoogahi, H. K., Fagg, A., Huang, C., Ramanan, D., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.128 · Cited by 522
“In recent years, significant attention has been paid to Correlation Filter (CF) based methods [3, 14, 9, 16, 17, 1] for visual tracking.”
BackgroundMethodInfluentialAction-Decision Networks for Visual Tracking with Deep Reinforcement Learning
Yun, S., Choi, J., Yoo, Y., Yun, K., & Choi, J. Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.148 · Cited by 530
“[2] proposed a minimum output sum of squared error (MOSSE) filter and Henriques et al.”
MethodUnveiling the Power of Deep Tracking
Bhat, G., Johnander, J., Danelljan, M., Khan, F. S., & Felsberg, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_30 · Cited by 514
Discriminative Correlation Filter Tracker with Channel and Spatial Reliability
Lukežič, A., Vojíř, T., Čehovin Zajc, L., Matas, J., & Kristan, M. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-017-1061-3 · Cited by 370
“In particular, trackers based on the discriminative correlation filter method (DCF) [4, 8, 19, 30, 10] have shown state-of-theart performance in all standard benchmarks.”
BackgroundMethodResultInfluentialMulti-cue Correlation Filters for Robust Visual Tracking
Wang, N., Zhou, W., Tian, Q., Hong, R., Wang, M., & Li, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00509 · Cited by 470
“Different from the previous DCF based methods [4, 16] that usually lack the diversity of target appearance representations, our method maintains multiple experts to learn the appearance models from different views.”
BackgroundMethodInfluentialDeformable Siamese Attention Networks for Visual Object Tracking
Yu, Y., Xiong, Y., Huang, W., & Scott, M. R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00676 · Cited by 495
Learning the Model Update for Siamese Trackers
Zhang, L., Gonzalez-Garcia, A., Weijer, J. V. D., Danelljan, M., & Khan, F. S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00411 · Cited by 475
“[3, 19]), T corresponds to the correlation filter.”
BackgroundMethodInfluentialTransforming Model Prediction for Tracking
Mayer, C., Danelljan, M., Bhat, G., Paul, M., Paudel, D. P., Yu, F., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00853 · Cited by 434
“The model predictor estimates the weights of the compact DCF target model to localize the target in the test frame.”
BackgroundMethodInfluentialLi, Y., Fu, C., Ding, F., Huang, Z., & Lu, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01194 · Cited by 418
“Tracking by detection: tracking-by-detection framework, which regards the tracking as a classification problem, is widely adopted in UAV [5, 6, 7, 27, 28].”
BackgroundMethodVisual Tracking via Adaptive Spatially-Regularized Correlation Filters
Dai, K., Wang, D., Lu, H., Sun, C., & Li, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00480 · Cited by 434
“The MOSSE [3] method is the earliest CF-based tracker, which uses only grayscale samples to train the filter.”
MethodThe Visual Object Tracking VOT2017 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Zajc, L. C., Vojir, T., Hager, G., Lukezic, A., Eldesokey, A., et al. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.230 · Cited by 434
“Submitted by VOT Committee The Discriminative Scale Space Tracker (DSST) [13] extends the Minimum Output Sum of Squared Errors (MOSSE) tracker [7] with robust scale estimation.”
MethodWang, N., Song, Y., Ma, C., Zhou, W., Liu, W., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00140 · Cited by 416
“The Discriminative Correlation Filters (DCFs) [2, 16] regress the input features of a search patch to a Gaussian response map for target localization.”
BackgroundMethodLearning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking
Huang, Z., Fu, C., Li, Y., Lin, F., & Lu, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00298 · Cited by 414
“[2] who proposed a method called minimum output sum of squared error (MOSSE) filter.”
MethodDanelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.159 · Cited by 430
“Continuous weights: Most existing discriminative trackers [1, 16, 25, 29] rely on binary decisions for including or removing potential training samples.”
BackgroundMethodInfluentialMulti-task Correlation Particle Filter for Robust Object Tracking
Zhang, T., Xu, C., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.512 · Cited by 426
“Correlation filters have recently been introduced into visual tracking and shown to achieve high speed as well as robust performance [4, 9, 16, 15, 18, 26, 24, 21, 25, 29].”
BackgroundTransVG: End-to-End Visual Grounding with Transformers
Deng, J., Yang, Z., Chen, T., Zhou, W., & Li, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00179 · Cited by 372
“RCCF [27] formulates the visual grounding problem as a correlation filtering process [4, 17], and picks the peak value of the correlation heatmap as the center of target objects.”
BackgroundKnow Your Surroundings: Exploiting Scene Information for Object Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_13 · Cited by 362
Xu, T., Feng, Z.-H., Wu, X.-J., & Kittler, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2919201 · Cited by 412
“Recently, considering the joint circular structure of sliding candidates, Discriminative Correlation Filter (DCF) based tracking methods [7], [8] have achieved outstanding performance in many challenging benchmarks and competitions [5], [9], [10].”
BackgroundMethodReal-time part-based visual tracking via adaptive correlation filters
Liu, T., Wang, G., & Yang, Q. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299124 · Cited by 402
In defense of color-based model-free tracking
Possegger, H., Mauthner, T., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298823 · Cited by 370
“This distance term penalizes large inter-frame movements, similar to the Gaussian and cosine windowing approaches used by correlation based trackers such as [10, 13, 23].”
BackgroundMethodUnderstanding and Diagnosing Visual Tracking Systems
Wang, N., Shi, J., Yeung, D.-Y., & Jia, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.355 · Cited by 365
“For example, fast Fourier transform (FFT) [5] and circular matrices [15, 9] are used to accelerate dense (kernelized) ridge regression.”
MethodCorrelation filters with limited boundaries
Galoogahi, H. K., Sim, T., & Lucey, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299094 · Cited by 355
Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches
Li, Y., Zhu, J., & Hoi, S. C. H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298632 · Cited by 356
“Since it is hard to find the exact reliable patches, we explore the Sequential Monte Carlo Framework [2] to estimate their probability distribution.”
MethodLaSOT: A High-quality Large-scale Single Object Tracking Benchmark
Fan, H., Bai, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Harshit, Huang, M., Liu, J., et al. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01387-y · Cited by 360
“Owing to the extremely efficient solution using fast Fourier transform (FFT), correlation-filter trackers [8, 39] run at speeds of several hundred frames per second and draw extensive attention with many improvements.”
MethodHiFT: Hierarchical Feature Transformer for Aerial Tracking
Cao, Z., Fu, C., Ye, J., Li, B., & Li, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01517 · Cited by 325
Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
Fan, H., & Ling, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.585 · Cited by 329
“, [5, 7, 16, 43]), represented by the series of trackers based on correlation filters.”
BackgroundAttentional Correlation Filter Network for Adaptive Visual Tracking
Choi, J., Chang, H. J., Yun, S., Fischer, T., Demiris, Y., & Choi, J. Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.513 · Cited by 311
“Correlation filter based trackers: Correlation filter based approaches have recently become increasingly popular due to the rapid speed of correlation filter calculations [2,3,5,7,16,18,27].”
BackgroundEnd-to-End Flow Correlation Tracking with Spatial-Temporal Attention
Zhu, Z., Wu, W., Zou, W., & Yan, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00064 · Cited by 311
TCTrack: Temporal Contexts for Aerial Tracking
Cao, Z., Huang, Z., Pan, L., Zhang, S., Liu, Z., & Fu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01438 · Cited by 272
“firstly proposed the MOSSE filter [5], many researches [16,31,38] have been made to boost the tracking performance.”
BackgroundOverview and methods of correlation filter algorithms in object tracking
Liu, S., Liu, D., Srivastava, G., Połap, D., & Woźniak, M. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00161-4 · Cited by 305
“By learning from gray images, the minimum output sum of squared error (MOSSE) [16] filter applies correlation filter to the tracking field for the first time.”
MethodD3S – A Discriminative Single Shot Segmentation Tracker
Lukezic, A., Matas, J., & Kristan, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00716 · Cited by 300
Real-Time Driver-Drowsiness Detection System Using Facial Features
Deng, W., & Wu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2936663 · Cited by 279
“[20] D. S. Bolme, J. R. Beveridge, B. A. Draper, and Y. M. Lui, ‘‘Visual object tracking using adaptive correlation filters,’’ in Proc.”
MethodArtificial intelligence (AI) in augmented reality (AR)-assisted manufacturing applications: a review
Sahu, C. K., Young, C., & Rai, R. (2021) · International Journal of Production Research · doi:10.1080/00207543.2020.1859636 · Cited by 256
“Further improvements of DCF-based approaches for increasing the tracking speed reduced the accuracy significantly (Bolme et al. 2010).”
BackgroundFast and Accurate Online Video Object Segmentation via Tracking Parts
Cheng, J., Tsai, Y.-H., Hung, W.-C., Wang, S., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00774 · Cited by 275
Material Based Object Tracking in Hyperspectral Videos
Xiong, F., Zhou, J., & Qian, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2965302 · Cited by 256
End-to-End Representation Learning for Correlation Filter Based Tracking
Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., & Torr, P. H. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.531 · Cited by 274
“To reduce the effect of circular boundaries, the feature map x is pre-multiplied by a cosine window [4] and the final template is cropped [29].”
BackgroundMethodInfluentialNew Generation Deep Learning for Video Object Detection: A Survey
Jiao, L., Zhang, R., Liu, F., Yang, S., Hou, B., Li, L., & Tang, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3053249 · Cited by 259
Fuzzy Detection Aided Real-Time and Robust Visual Tracking Under Complex Environments
Liu, S., Wang, S., Liu, X., Lin, C.-T., & Lv, Z. (2021) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2020.3006520 · Cited by 272
“[11] applied the correlation filtering theory to online”
MethodSPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking
Wang, G., Luo, C., Xiong, Z., & Zeng, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00376 · Cited by 263
“[4] first proposed the MOSSE filter which is capable of producing stable CFs from a single frame and then continuously being improved during tracking.”
BackgroundMulti-channel Correlation Filters
Galoogahi, H. K., Sim, T., & Lucey, S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.381 · Cited by 266
“[3] recently proposed an extension to traditional correlation filters referred to as Minimum Output Sum of Squared Error (MOSSE) filters.”
BackgroundMethodTransformer Tracking with Cyclic Shifting Window Attention
Song, Z., Yu, J., Chen, Y.-P. P., & Yang, W. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00859 · Cited by 237
“CF based approaches [4, 5, 9, 11, 16, 20, 42] exploit the convolution theorem and train a filter in the Fourier domain that maps known target images to the desired output.”
BackgroundHuman Memory Update Strategy: A Multi-Layer Template Update Mechanism for Remote Visual Monitoring
Liu, S., Wang, S., Liu, X., Gandomi, A. H., Daneshmand, M., Muhammad, K., & De Albuquerque, V. H. C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3065580 · Cited by 253
Deep Regression Tracking with Shrinkage Loss
Lu, X., Ma, C., Ni, B., Yang, X., Reid, I., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_22 · Cited by 243
“One representative category of one-stage trackers are based on discriminative correlation filters [30], which regress all the circularly”
BackgroundJoint Monocular 3D Vehicle Detection and Tracking
Hu, H.-N., Cai, Q.-Z., Wang, D., Lin, J., Sun, M., Kraehenbuehl, P., Darrell, T., & Yu, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00549 · Cited by 249
“Early methods [5, 11, 23] track objects based on correlation filters.”
MethodA review on absolute visual localization for UAV
Couturier, A., & Akhloufi, M. A. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2020.103666 · Cited by 230
Deep convolutional neural networks for thermal infrared object tracking
Liu, Q., Lu, X., He, Z., Zhang, C., & Chen, W.-S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.07.032 · Cited by 239
“Henriques et al. [49] improve the MOSSE filter by introducing kernel methods due to the limited ability of the linear classification in MOSSE.”
BackgroundMethodInfluentialA Real-Time Cross-Modality Correlation Filtering Method for Referring Expression Comprehension
Liao, Y., Liu, S., Li, G., Wang, F., Chen, Y., Qian, C., & Li, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01089 · Cited by 221
Context-Aware Deep Feature Compression for High-Speed Visual Tracking
Choi, J., Chang, H. J., Fischer, T., Yun, S., Lee, K., Jeong, J., Demiris, Y., & Choi, J. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00057 · Cited by 229
Learning Policies for Adaptive Tracking with Deep Feature Cascades
Huang, C., Lucey, S., & Ramanan, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.21 · Cited by 235
“The pioneering MOSSE [4] and improved Kernelized Correlation Filter (KCF) [19] trackers can operate at 669 fps and 292 fps respectively on a single CPU, which far exceeds the real-time requirement.”
BackgroundMethodInfluentialAMP: Adaptive Masked Proxies for Few-Shot Segmentation
Siam, M., Oreshkin, B., & Jagersand, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00535 · Cited by 206
“The adaptation part of our method is inspired by the classical approaches in learning adaptive correlation filters [1, 7].”
MethodInfluentialOcclusion-Aware Real-Time Object Tracking
Dong, X., Shen, J., Yu, D., Wang, W., Liu, J., & Huang, H. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2631884 · Cited by 234
“Correlation filters have also been widely used in many applications such as object detection and tracking [31], [32].”
MethodJoint Group Feature Selection and Discriminative Filter Learning for Robust Visual Object Tracking
Xu, T., Feng, Z.-H., Wu, X.-J., & Kittler, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00804 · Cited by 222
“One of the seminal works in the development of DCF is MOSSE [7], which formulates the tracking task as discriminative filter learning [8] rather than template matching [10].”
BackgroundMulti-Modal Fusion for End-to-End RGB-T Tracking
Zhang, L., Danelljan, M., Gonzalez-Garcia, A., van de Weijer, J., & Shahbaz Khan, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00278 · Cited by 212
“An alternative approach to Siamese networks is correlation filter (CF) based tracking [7, 22, 20, 16, 56, 59, 57, 12, 14, 15, 41, 26, 38, 40], which has occupied top positions for many years given its discriminative abilities and efficient tracking speed.”
BackgroundLearning Spatial-Aware Regressions for Visual Tracking
Sun, C., Wang, D., Lu, H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00934 · Cited by 221
VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flows
Wang, X., Li, J., Zhu, L., Zhang, Z., Chen, Z., Li, X., Wang, Y., Tian, Y., & Wu, F. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3318601 · Cited by 176
“Correlation Filter based Trackers: KCF [28], STRCF [43], MOSSE [5], CSK [27], CN [17], DAT [57], LDES [49].”
MethodDynamical Hyperparameter Optimization via Deep Reinforcement Learning in Tracking
Dong, X., Shen, J., Wang, W., Shao, L., Ling, H., & Porikli, F. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2956703 · Cited by 218
“MOSSE [6] and the improved Kernelized Correlation Filter (KCF) [24] can run at 669 fps and 292 fps , respectively.”
BackgroundMethod
Metadata
- Authors
- Bolme, D., Beveridge, J. R., Draper, B. A., & Lui, Y. M.
- Affiliations
- Colorado State University (US)
- Venue
- 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2010-06
- Pages
- 2544-2550
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1964846093
- Cited by
- 3,406
- References
- 19
- Citations by year
- 2026: 78 · 2025: 165 · 2024: 246 · 2023: 327 · 2022: 391 · 2021: 442 · 2020: 433 · 2019: 493 · 2018: 372 · 2017: 206 · 2016: 118 · 2015: 71 · 2014: 36 · 2013: 16 · 2012: 8
- FWCI
- 7.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Infrared Target Detection Methodologies
- Keywords
- visual object tracking, correlation filter, occlusion detection, peak-to-sidelobe ratio, non-rigid deformation, real-time tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.