Fast and Robust Object Tracking Using Tracking Failure Detection in Kernelized Correlation Filter
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Object tracking has long been an active research topic in image processing and computer vision fields with various application areas. For practical applications, the object tracking technique should be not only accurate but also fast in a real-time streaming condition. Recently, deep feature-based trackers have been proposed to achieve a higher accuracy, but those are not suitable for real-time tracking because of an extremely slow processing speed. The slow speed is a major factor to degrade tracking accuracy under a real-time streaming condition since the processing delay forces skipping frames. To increase the tracking accuracy with preserving the processing speed, this paper presents an improved kernelized correlation filter (KCF)-based tracking method that integrates three functional modules: (i) tracking failure detection, (ii) re-tracking using multiple search windows, and (iii) motion vector analysis to decide a preferred search window. Under a real-time streaming condition, the proposed method yields better results than the original KCF in the sense of tracking accuracy, and when a target has a very large movement, the proposed method outperforms a deep learning-based tracker, such as multi-domain convolutional neural network (MDNet).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most algorithms, such as SAMF, use Maximum response value for scale searching. In turn, this degrades the performance of the overall tracking scheme when the video sequence contains one or more challenging factors, such as scale variation, occlusion, motion blur, etc. [5].”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [5]
In the citing paper
“The proposed tracking scheme outperforms the other state-of-the-art algorithms by achieving the highest mean of 0.889.”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [5]
In the citing paper
“while the remaining three trackers, i.e., STRCF [28], LCT [21], and MKCF [5], have a mean overlap success rate of 0.799, 0.717, and 0.645, respectively.”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [5]
In the citing paper
“whereas MKCF [5] lost the target in frame number 999.”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [5]
In the citing paper
“The second-best in terms of distance precision is MKCF [5], with a mean value of 0.855”
From Multiple Cues-Based Robust Visual Object Tracking Method (2022) · cites this paper as [5]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138 · cited 3×
“After experiments using Visual Tracker Benchmark dataset [29], we found that the optimal α is 0.”
MethodInfluentialVisual object tracking using adaptive correlation filters
Bolme, D., Beveridge, J. R., Draper, B. A., & Lui, Y. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539960 · Cited by 3,406 · cited 1×
“[12] proposed an improved version of ASEF, called minimum output sum of square error (MOSSE)-based tracker.”
BackgroundLearning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806 · cited 1×
“[20] presented multi-domain network (MDNet) that consists of shared layers and a domain-specific fully connected layer.”
BackgroundExploiting the Circulant Structure of Tracking-by-Detection with Kernels
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_50 · Cited by 2,310 · cited 2×
“Henriques et al. proposed circulant structured with kernels (CSK) [1] method that exploits the correlation filter in kernel space, and kernelized correlation filter (KCF) [2] extends the kernel trick.”
BackgroundMethodStaple: Complementary Learners for Real-Time Tracking
Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., & Torr, P. H. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.156 · Cited by 1,776 · cited 1×
“[16] presented sum of template and pixel-wise learners (STAPLE) method using HOG and color histograms for target representation.”
MethodDiscriminative Scale Space Tracking
Danelljan, M., Hager, G., Khan, F. S., & Felsberg, M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2609928 · Cited by 1,315
Learning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199 · cited 1×
“Held et al. [22] proposed generic object tracking using regression network (GOTURN) based on the Siamese network.”
MethodRobust object tracking via sparsity-based collaborative model
Zhong, W., Lu, H., & Yang, M.-H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247882 · Cited by 990
Long-term correlation tracking
Ma, C., Yang, X., Zhang, C., & Yang, M.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299177 · Cited by 959 · cited 1×
“[15] proposed long-term correlation tracker (LCT), which is robust against target translation and can perform re-detection if tracking failure occurs.”
BackgroundQi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.466 · Cited by 705 · cited 2×
“[5] proposed hedged deep tracker (HDT), in which several weak trackers are combined to realize a strong tracker.”
BackgroundVisual tracking with online Multiple Instance Learning
Babenko, B., Yang, M.-H., & Belongie, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvprw.2009.5206737 · Cited by 637
Need for Speed: A Benchmark for Higher Frame Rate Object Tracking
Galoogahi, H. K., Fagg, A., Huang, C., Ramanan, D., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.128 · Cited by 522 · cited 2×
“presented that CF based trackers outperform deep feature based trackers not only in speed but also in accuracy under high FPS circumstances [6].”
BackgroundReal-time part-based visual tracking via adaptive correlation filters
Liu, T., Wang, G., & Yang, Q. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299124 · Cited by 402 · cited 1×
“[14] tried to solve the partial occlusion problem using multiple correlation filters.”
MethodUnconstrained correlation filters
Mahalanobis, A., Vijaya Kumar, B. V. K., Song, S., Sims, S. R. F., & Epperson, J. F. (1994) · Applied Optics · doi:10.1364/ao.33.003751 · Cited by 293
SANet: Structure-Aware Network for Visual Tracking
Fan, H., & Ling, H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.275 · Cited by 256 · cited 1×
“[21] proposed structure aware network (SANet) as an extended version of MDNet.”
BackgroundPartial Occlusion Handling for Visual Tracking via Robust Part Matching
Zhang, T., Jia, K., Xu, C., Ma, Y., & Ahuja, N. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.164 · Cited by 117 · cited 1×
“Various tracking approaches have been proposed to solve challenging problems, such as background clutters, partial occlusion, shape deformation, temporary disappearance, illumination changes, etc. [7–9].”
BackgroundOnce for All: A Two-Flow Convolutional Neural Network for Visual Tracking
Chen, K., & Tao, W. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2757061 · Cited by 94
Average of Synthetic Exact Filters
Bolme, D. S., Draper, B. A., & Beveridge, J. R. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206701 · Cited by 33
Online Siamese Network for Visual Object Tracking
Chang, S., Li, W., Zhang, Y., & Feng, Z. (2019) · Sensors · doi:10.3390/s19081858 · Cited by 12 · cited 1×
“More recently, Shuo et al. [23] proposed lightweight Siamese network based tracker which can perform which can be updated during tracking process, and Lijun et al. [24] presented a tracking method based on multi-feature fusion Siamese network with Kalman filter.”
MethodCombined Kalman Filter and Multifeature Fusion Siamese Network for Real-Time Visual Tracking
Zhou, L., & Zhang, J. (2019) · Sensors · doi:10.3390/s19092201 · Cited by 12 · cited 1×
“[24] presented a tracking method based on multi-feature fusion Siamese network with Kalman filter.”
MethodParallel Correlation Filters for Real-Time Visual Tracking
Yang, Y., Zhang, Y., Li, D., & Wang, Z. (2019) · Sensors · doi:10.3390/s19102362 · Cited by 11 · cited 1×
“[17] proposed Parallel Correlation Filters, Zhaohui et al.”
MethodHao, Z., Liu, G., Gao, J., & Zhang, H. (2019) · Sensors · doi:10.3390/s19194178 · Cited by 6 · cited 1×
“[18] presented a tracker using correlation filter fused with color histogram and Hao et al.”
MethodScene Mapping-based Video Registration Using Frame Similarity Measurement and Feature Tracking
Choo, Y.-S., Jang, J., & Paik, J. (2019) · IEIE Transactions on Smart Processing and Computing · doi:10.5573/ieiespc.2019.8.6.456 · Cited by 5
Self-citationReal-time Parallel Image-processing Scheme for a Fire-control System
Moon, C.-B., Kim, B. M., & Kim, D.-S. (2019) · IEIE Transactions on Smart Processing and Computing · doi:10.5573/ieiespc.2019.8.1.027 · Cited by 3
Self-citationImproved Correlation Filter Tracking with Enhanced Features and Adaptive Kalman Filter
Yang, H., Huang, Y., & Xie, Z. (2019) · Sensors · doi:10.3390/s19071625 · Cited by 3 · cited 1×
“[19] proposed a correlation filter-based tracker using enhanced features and adaptive Kalman filter.”
MethodTarget Identification Using a Moment Invariant Approach
Al-Ani, M. S., & Darwesh, A. M. (2019) · IEIE Transactions on Smart Processing and Computing · doi:10.5573/ieiespc.2019.8.5.335 · Cited by 3
Robust Kernelized Correlation Filter using Adaptive Feature Weight
Kim, Y., Park, H., & Paik, J. (2018) · IEIE Transactions on Smart Processing & Computing · doi:10.5573/ieiespc.2018.7.6.433 · Cited by 2
Self-citationVideo Summarization using Low-Rank Sparse Representation
Kim, H., & Paik, J. (2018) · IEIE Transactions on Smart Processing and Computing · doi:10.5573/ieiespc.2018.7.3.236 · Cited by 1 · cited 1×
“Therefore, it is still worth improving the CF-based tracking methods since low-cost, real-time application is still ubiquitous in visual surveillance applications and numbers of image processing solutions [25–28].”
BackgroundSelf-citation
Cited by
Kalake, L., Wan, W., & Hou, L. (2021) · IEEE Access · doi:10.1109/access.2021.3060821 · Cited by 68
“In contrast [2], [22]–[24], [46], [54]–[61], [82], classified and assessed the matches between detection and tracklets to quickly track the targets.”
BackgroundMethodWang, X., Sun, Z., Chehri, A., Jeon, G., & Song, Y. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102247 · Cited by 78
Multiple Object Tracking in Deep Learning Approaches: A Survey
Park, Y., Dang, L. M., Lee, S., Han, D., & Moon, H. (2021) · Electronics · doi:10.3390/electronics10192406 · Cited by 69
Automatic Object Tracking and Segmentation Using Unsupervised SiamMask
Noor, S., Waqas, M., Saleem, M. I., & Minhas, H. N. (2021) · IEEE Access · doi:10.1109/access.2021.3101054 · Cited by 51
“[23] proposed a modified kernalized correlation filter (KCF) that identifies tracking failure and tries to resume tracking by searching over multiple windows.”
BackgroundObject tracking and detection techniques under GANN threats: A systemic review
Jaberi, S. M. A., Patel, A., & AL-Masri, A. N. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110224 · Cited by 31
Metadata
- Authors
- Shin, J., Kim, H., Kim, D., & Paik, J.
- Affiliations
- Chung-Ang University (KR)
- Corresponding author
- Paik, Joonki
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2020-01-20
- Volume
- 10
- Issue
- 2
- Pages
- 713
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2999749273
- Cited by
- 42
- References
- 29
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 11 · 2022: 7 · 2021: 13 · 2020: 2
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Institute for Information and Communications Technology Promotion (IITP) grant funded by the Korea government (2017-0-00250)
- ICT R&D program of MSIP/IITP (2014-0-00077)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- object tracking, kernelized correlation filter, tracking failure detection, motion vector analysis, live streaming, fast tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.