The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking
Abstract
Integrating multiple different yet complementary feature representations has been proved to be an effective way for boosting tracking performance. This paper investigates how to perform robust object tracking in challenging scenarios by adaptively incorporating information from grayscale and thermal videos, and proposes a novel collaborative algorithm for online tracking. In particular, an adaptive fusion scheme is proposed based on collaborative sparse representation in Bayesian filtering framework. We jointly optimize sparse codes and the reliable weights of different modalities in an online way. In addition, this paper contributes a comprehensive video benchmark, which includes 50 grayscale-thermal sequences and their ground truth annotations for tracking purpose. The videos are with high diversity and the annotations were finished by one single person to guarantee consistency. Extensive experiments against other state-of-the-art trackers with both grayscale and grayscale-thermal inputs demonstrate the effectiveness of the proposed tracking approach. Through analyzing quantitative results, we also provide basic insights and potential future research directions in grayscale-thermal tracking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Donoho, D. L. (2004) · Cited by 16,703
FCM: The fuzzy c-means clustering algorithm
Bezdek, J. C., Ehrlich, R., & Full, W. (1984) · Computers & Geosciences · doi:10.1016/0098-3004(84)90020-7 · Cited by 6,608
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
Parikh, N., & Boyd, S. (2014) · Foundations and Trends® in Optimization · doi:10.1561/2400000003 · Cited by 4,102
Kalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Accurate Scale Estimation for Robust Visual Tracking
Danelljan, M., Häger, G., Shahbaz Khan, F., & Felsberg, M. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.65 · Cited by 2,087
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007
Struck: Structured output tracking with kernels
Hare, S., Saffari, A., & Torr, P. H. S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126251 · Cited by 1,831
Adaptive Color Attributes for Real-Time Visual Tracking
Danelljan, M., Khan, F. S., Felsberg, M., & Van De Weijer, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.143 · Cited by 1,500
Real-Time Compressive Tracking
Zhang, K., Zhang, L., & Yang, M.-H. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_62 · Cited by 1,427
MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization
Zhang, J., Ma, S., & Sclaroff, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_13 · Cited by 1,117
Robust object tracking via sparsity-based collaborative model
Zhong, W., Lu, H., & Yang, M.-H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247882 · Cited by 990
Real time robust L1 tracker using accelerated proximal gradient approach
Bao, C., Wu, Y., Ling, H., & Ji, H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247881 · Cited by 835
Thermal cameras and applications: A survey
Gade, R., & Moeslund, T. B. (2014) · Machine Vision and Applications · doi:10.1007/s00138-013-0570-5 · Cited by 780
(2009) · doi:10.1109/iccv.2009.5459292 · Cited by 779
Fast Visual Tracking via Dense Spatio-temporal Context Learning
Zhang, K., Zhang, L., Liu, Q., Zhang, D., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_9 · Cited by 663
Robust visual tracking via multi-task sparse learning
Zhang, T., Ghanem, B., Liu, S., & Ahuja, N. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247908 · Cited by 647
MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking
Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., & Tao, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298675 · Cited by 644
Robust Visual Tracking via Structured Multi-Task Sparse Learning
Zhang, T., Ghanem, B., Liu, S., & Ahuja, N. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0582-z · Cited by 426
Background-subtraction using contour-based fusion of thermal and visible imagery
Davis, J. W., & Sharma, V. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.06.010 · Cited by 418
Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches
Li, Y., Zhu, J., & Hoi, S. C. H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298632 · Cited by 356
Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines
Song, S., & Xiao, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.36 · Cited by 269
Torabi, A., Massé, G., & Bilodeau, G.-A. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2011.10.006 · Cited by 161
Multiple Source Data Fusion via Sparse Representation for Robust Visual Tracking
Wu, Y., Blasch, E., Chen, G., Li, B., & Ling, H. (2012) · Cited by 158
Visual Tracking via Probability Continuous Outlier Model
Wang, D., & Lu, H. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.445 · Cited by 113
Fusion tracking in color and infrared images using joint sparse representation
Liu, H., & Sun, F. (2012) · Science China Information Sciences · doi:10.1007/s11432-011-4536-9 · Cited by 112
Blurred target tracking by Blur-driven Tracker
Wu, Y., Ling, H., Jingyi Yu, A., Li, F., Mei, X., & Cheng, E. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126357 · Cited by 97
Thermo-visual feature fusion for object tracking using multiple spatiogram trackers
Conaire, C. Ó., O'Connor, N. E., & Smeaton, A. F. (2007) · Machine Vision and Applications · doi:10.1007/s00138-007-0078-y · Cited by 91
Comparison of Fusion Methods for Thermo-Visual Surveillance Tracking
Conaire, C. Ó., O'Connor, N. E., Cooke, E., & Smeaton, A. F. (2006) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2006.301618 · Cited by 89
Thermal–visible registration of human silhouettes: A similarity measure performance evaluation
Bilodeau, G.-A., Torabi, A., St-Charles, P.-L., & Riahi, D. (2014) · Infrared Physics & Technology · doi:10.1016/j.infrared.2014.02.005 · Cited by 74
Pedestrian tracking by fusion of thermal-visible surveillance videos
Leykin, A., & Hammoud, R. I. (2008) · Machine Vision and Applications · doi:10.1007/s00138-008-0176-5 · Cited by 72
WELD: Weighted Low-rank Decomposition for Robust Grayscale-Thermal Foreground Detection
Li, C., Wang, X., Zhang, L., Tang, J., Wu, H., & Lin, L. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2556586 · Cited by 71
Self-citationThe Effect of Pixel-Level Fusion on Object Tracking in Multi-Sensor Surveillance Video
Cvejic, N., Nikolov, S. G., Knowles, H. D., Łoza, A., Achim, A., Bull, D., & Canagarajah, C. N. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383433 · Cited by 60
Geodesic Active Contour Based Fusion of Visible and Infrared Video for Persistent Object Tracking
Bunyak, F., Palaniappan, K., Nath, S., & Seetharaman, G. S. (2007) · Proceedings · doi:10.1109/wacv.2007.26 · Cited by 54
Order determination and sparsity-regularized metric learning adaptive visual tracking
Jiang, N., Liu, W., & Wu, Y. N. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247897 · Cited by 48
An Approach to Streaming Video Segmentation With Sub-Optimal Low-Rank Decomposition
Li, C., Lin, L., Zuo, W., Wang, W., & Tang, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2537211 · Cited by 46
Self-citationSOLD: Sub-optimal low-rank decomposition for efficient video segmentation
Li, C., Lin, L., Zuo, W., Yan, S., & Tang, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299191 · Cited by 40
Self-citationReal-Time Grayscale-Thermal Tracking via Laplacian Sparse Representation
Li, C., Hu, S., Gao, S., & Tang, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27674-8_6 · Cited by 38
Self-citationQuality-Based Multimodal Classification Using Tree-Structured Sparsity
Bahrampour, S., Ray, A., Nasrabadi, N. M., & Jenkins, K. W. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.524 · Cited by 16
Quality-based multimodal classification using tree-structured sparsity
Bahrampour, S., Ray, A., Nasrabadi, N. M., & Jenkins, K. W. (n.d.) · Cited by 16
Cited by
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
RGB-T object tracking: Benchmark and baseline
Li, C., Liang, X., Lu, Y., Zhao, N., & Tang, J. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106977 · Cited by 581
Self-citationLRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images
Li, H., Xu, T., Wu, X.-J., Lu, J., & Kittler, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3268209 · Cited by 493
LasHeR: A Large-Scale High-Diversity Benchmark for RGBT Tracking
Li, C., Xue, W., Jia, Y., Qu, Z., Luo, B., Tang, J., & Sun, D. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3130533 · Cited by 307
Self-citation
Metadata
- Authors
- Li, C., Cheng, H., Hu, S., Liu, X., Tang, J., & Lin, L.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-12
- Volume
- 25
- Issue
- 12
- Pages
- 5743-5756
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2527415613
- Cited by
- 391
- References
- 43
- FWCI
- 13.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.