The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Tracking-Learning-Detection
Abstract
This paper investigates long-term tracking of unknown objects in a video stream. The object is defined by its location and extent in a single frame. In every frame that follows, the task is to determine the object's location and extent or indicate that the object is not present. We propose a novel tracking framework (TLD) that explicitly decomposes the long-term tracking task into tracking, learning, and detection. The tracker follows the object from frame to frame. The detector localizes all appearances that have been observed so far and corrects the tracker if necessary. The learning estimates the detector's errors and updates it to avoid these errors in the future. We study how to identify the detector's errors and learn from them. We develop a novel learning method (P-N learning) which estimates the errors by a pair of "experts": (1) P-expert estimates missed detections, and (2) N-expert estimates false alarms. The learning process is modeled as a discrete dynamical system and the conditions under which the learning guarantees improvement are found. We describe our real-time implementation of the TLD framework and the P-N learning. We carry out an extensive quantitative evaluation which shows a significant improvement over state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
(1981) · Cited by 11,963
Horn, B. K. P., & Schunck, B. G. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90024-2 · Cited by 10,312
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 2×
“Various representations of the object are used in practice, for example, points [2], [3], [4], articulated models [5], [6], [7], contours [8], [9], [10], [11], or optical flow [12], [13], [14].”
BackgroundHorn, B. K., & Schunck, B. G. (1981) · SPIE Proceedings · doi:10.1117/12.965761 · Cited by 7,394
Ogata, K., & Brewer, J. W. (1971) · Journal of Dynamic Systems, Measurement, and Control · doi:10.1115/1.3426465 · Cited by 6,358
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Cited by
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Fully-Convolutional Siamese Networks for Object Tracking
Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
A Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
LaSOT: A High-Quality Benchmark for Large-Scale Single Object Tracking
Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Bai, H., Xu, Y., Liao, C., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00552 · Cited by 1,742
“…techniques ( e.g ., BACF [15], SRDCF [10], CSRDCF [36], Staple CA [40] and STRCF [29]), ensemble trackers ( e.g ., PTAV [13], LCT [38], MEEM [56] and TLD [24]), sparse trackers ( e.g ., L1APG [2] and ASLA [23]), other representatives ( e.g ., CT [58], IVT [44], MIL [1] and Struck [17]).”
MethodDetection and tracking meet drones challenge
Zhu, P., Wen, L., Du, D., Bian, X., Fan, H., Hu, Q., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3119563 · Cited by 1,336
Siamese Instance Search for Tracking
Tao, R., Gavves, E., & Smeulders, A. W. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.158 · Cited by 1,208
Learning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199
TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192
Discriminative Correlation Filter with Channel and Spatial Reliability
Lukezic, A., Vojir, T., Zajc, L. C., Matas, J., & Kristan, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.515 · Cited by 1,153
Self-citationEncoding Color Information for Visual Tracking: Algorithms and Benchmark
Liang, P., Blasch, E., & Ling, H. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2482905 · Cited by 726
DiffusionDet: Diffusion Model for Object Detection
Chen, S., Sun, P., Song, Y., & Luo, P. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01816 · Cited by 657
Deep visual tracking: Review and experimental comparison
Li, P., Wang, D., Wang, L., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.007 · Cited by 517
Deformable Siamese Attention Networks for Visual Object Tracking
Yu, Y., Xiong, Y., Huang, W., & Scott, M. R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00676 · Cited by 495
Learning Correspondence From the Cycle-Consistency of Time
Wang, X., Jabri, A., & Efros, A. A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00267 · Cited by 445
In defense of color-based model-free tracking
Possegger, H., Mauthner, T., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298823 · Cited by 370
LaSOT: A High-quality Large-scale Single Object Tracking Benchmark
Fan, H., Bai, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Harshit, Huang, M., Liu, J., et al. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01387-y · Cited by 360
Consistent video depth estimation
Luo, X., Huang, J.-B., Szeliski, R., Matzen, K., & Kopf, J. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392377 · Cited by 322
High-Performance Long-Term Tracking With Meta-Updater
Dai, K., Zhang, Y., Wang, D., Li, J., Lu, H., & Yang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00633 · Cited by 310
The Visual Object Tracking VOT2013 Challenge Results
Kristan, M., Pflugfelder, R., Leonardis, A., Matas, J., Porikli, F., Cehovin, L., Nebehay, G., Fernandez, G., Vojir, T., Gatt, A., et al. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.20 · Cited by 308
Self-citationShakeri, R., Al-Garadi, M. A., Badawy, A., Mohamed, A., Khattab, T., Al-Ali, A. K., Harras, K. A., & Guizani, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924143 · Cited by 295
Symmetry-driven accumulation of local features for human characterization and re-identification
Bazzani, L., Cristani, M., & Murino, V. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.10.008 · Cited by 295
A review of video surveillance systems
Elharrouss, O., Almaadeed, N., & Al-Maadeed, S. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103116 · Cited by 283
Learning to Track for Spatio-Temporal Action Localization
Weinzaepfel, P., Harchaoui, Z., & Schmid, C. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.362 · Cited by 278
GlobalTrack: A Simple and Strong Baseline for Long-Term Tracking
Huang, L., Zhao, X., & Huang, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6758 · Cited by 279
The Eighth Visual Object Tracking VOT2020 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Kämäräinen, J.-K., Danelljan, M., Zajc, L. Č., Lukežič, A., Drbohlav, O., et al. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68238-5_39 · Cited by 259
Self-citationSTCT: Sequentially Training Convolutional Networks for Visual Tracking
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.153 · Cited by 258
Joint Monocular 3D Vehicle Detection and Tracking
Hu, H.-N., Cai, Q.-Z., Wang, D., Lin, J., Sun, M., Kraehenbuehl, P., Darrell, T., & Yu, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00549 · Cited by 249
‘Skimming-Perusal’ Tracking: A Framework for Real-Time and Robust Long-Term Tracking
Yan, B., Zhao, H., Wang, D., Lu, H., & Yang, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00247 · Cited by 218
Artificial Intelligence for Long-Term Robot Autonomy: A Survey
Kunze, L., Hawes, N., Duckett, T., Hanheide, M., & Krajnik, T. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2860628 · Cited by 191
No Blind Spots: Full-Surround Multi-Object Tracking for Autonomous Vehicles Using Cameras and LiDARs
Rangesh, A., & Trivedi, M. M. (2019) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2938110 · Cited by 158
Adaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking
Ma, C., Huang, J.-B., Yang, X., & Yang, M.-H. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1076-4 · Cited by 156
Partial Occlusion Handling for Visual Tracking via Robust Part Matching
Zhang, T., Jia, K., Xu, C., Ma, Y., & Ahuja, N. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.164 · Cited by 117
Visual Tracking via Probability Continuous Outlier Model
Wang, D., & Lu, H. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.445 · Cited by 113
Siam R-CNN: Visual Tracking by Re-Detection
Voigtlaender, P., Luiten, J., Torr, P. H. S., & Leibe, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00661 · Cited by 115
Balamuralidhar, N., Tilon, S., & Nex, F. (2021) · Remote Sensing · doi:10.3390/rs13040573 · Cited by 104
High-Speed Tracking with Multi-kernel Correlation Filters
Tang, M., Yu, B., Zhang, F., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00512 · Cited by 103
Online Model Distillation for Efficient Video Inference
Mullapudi, R. T., Chen, S., Zhang, K., Ramanan, D., & Fatahalian, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00367 · Cited by 96
A survey on online learning for visual tracking
Abbass, M. Y., Kwon, K.-C., Kim, N., Abdelwahab, S. A., El-Samie, F. E. A., & Khalaf, A. A. M. (2021) · The Visual Computer · doi:10.1007/s00371-020-01848-y · Cited by 64
Real-Time Scalable Visual Tracking via Quadrangle Kernelized Correlation Filters
Ding, G., Chen, W., Zhao, S., Han, J., & Liu, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2774778 · Cited by 54
Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT
Jie, Y., Leonidas, L., Mumtaz, F., & Ali, M. (2021) · Symmetry · doi:10.3390/sym13020308 · Cited by 44
SITUP: Scale Invariant Tracking Using Average Peak-to-Correlation Energy
Ma, H., Acton, S. T., & Lin, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2962694 · Cited by 39
Efficient object tracking using hierarchical convolutional features model and correlation filters
Abbass, M. Y., Kwon, K.-C., Kim, N., Abdelwahab, S. A., El-Samie, F. E. A., & Khalaf, A. A. M. (2021) · The Visual Computer · doi:10.1007/s00371-020-01833-5 · Cited by 24
Motion-Aware Correlation Filters for Online Visual Tracking
Zhang, Y., Yang, Y., Zhou, W., Shi, L., & Li, D. (2018) · Sensors · doi:10.3390/s18113937 · Cited by 20
Improved kernelized correlation filter tracking by using spatial regularization
Gao, L., Li, Y., & Ning, J. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.11.008 · Cited by 14
On the improvement of foreground–background model‐based object tracker
Hanif, M. S., Ahmad, S., & Khurshid, K. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0487 · Cited by 14
Metadata
- Authors
- Kalal, Z., Mikolajczyk, K., & Matas, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2012-07
- Volume
- 34
- Issue
- 7
- Pages
- 1409-1422
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2124211486
- Cited by
- 3,285
- References
- 78
- FWCI
- 138.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.