The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
LasHeR: A Large-Scale High-Diversity Benchmark for RGBT Tracking
Open accessAbstract
RGBT tracking receives a surge of interest in the computer vision community, but this research field lacks a large-scale and high-diversity benchmark dataset, which is essential for both the training of deep RGBT trackers and the comprehensive evaluation of RGBT tracking methods. To this end, we present a La rge- s cale H igh-diversity [Formula: see text]nchmark for short-term R GBT tracking (LasHeR) in this work. LasHeR consists of 1224 visible and thermal infrared video pairs with more than 730K frame pairs in total. Each frame pair is spatially aligned and manually annotated with a bounding box, making the dataset well and densely annotated. LasHeR is highly diverse capturing from a broad range of object categories, camera viewpoints, scene complexities and environmental factors across seasons, weathers, day and night. We conduct a comprehensive performance evaluation of 12 RGBT tracking algorithms on the LasHeR dataset and present detailed analysis. In addition, we release the unaligned version of LasHeR to attract the research interest for alignment-free RGBT tracking, which is a more practical task in real-world applications. The datasets and evaluation protocols are available at: https://github.com/mmic-lcl/Datasets-and-benchmark-code.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
LaSOT: A High-Quality Benchmark for Large-Scale Single Object Tracking
Fan, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., Bai, H., Xu, Y., Liao, C., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00552 · Cited by 1,742 · cited 1×
“The intrinsic differences among different tasks and the small-scale size of GTOT might result in suboptimal tracking performance [8].”
BackgroundATOM: Accurate Tracking by Overlap Maximization
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00479 · Cited by 1,591
Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00803 · Cited by 1,588 · cited 4×
“…verify the diversity and challenge of our proposed LasHeR dataset, we present the results of some RGB trackers on LasHeR dataset (RGB videos), LaSOT [8] and TrackingNet [63] in Table VI, including TransT [66], SiamFC++ [67], PrDiMP-50 [68],PrDiMP-18 [68], DiMP-50 [45], DiMP-18 [45] and ATOM [64].”
InfluentialLearning Discriminative Model Prediction for Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00628 · Cited by 1,515
Multispectral pedestrian detection: Benchmark dataset and baseline
Hwang, S., Park, J., Kim, N., Choi, Y., & Kweon, I. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298706 · Cited by 1,249
TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192
SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelines
Xu, Y., Wang, Z., Li, Z., Yuan, Y., & Yu, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6944 · Cited by 974
Probabilistic Regression for Visual Tracking
Danelljan, M., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00721 · Cited by 798
RGB-T object tracking: Benchmark and baseline
Li, C., Liang, X., Lu, Y., Zhao, N., & Tang, J. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106977 · Cited by 581
Self-citationThe Seventh Visual Object Tracking VOT2019 Challenge Results
Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., Kamarainen, J.-K., Zajc, L. C., Drbohlav, O., Lukezic, A., Berg, A., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00276 · Cited by 461
Self-citationWeakly-supervised convolutional neural networks for multimodal image registration
Hu, Y., Modat, M., Gibson, E., Li, W., Ghavami, N., Bonmati, E., Wang, G., Bandula, S., Moore, C. M., Emberton, M., et al. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.002 · Cited by 458
Background-subtraction using contour-based fusion of thermal and visible imagery
Davis, J. W., & Sharma, V. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.06.010 · Cited by 418
Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking
Li, C., Cheng, H., Hu, S., Liu, X., Tang, J., & Lin, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2614135 · Cited by 391
Self-citationWeakly Aligned Cross-Modal Learning for Multispectral Pedestrian Detection
Zhang, L., Zhu, X., Chen, X., Yang, X., Lei, Z., & Liu, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00523 · Cited by 271
Weighted Sparse Representation Regularized Graph Learning for RGB-T Object Tracking
Li, C., Zhao, N., Lu, Y., Zhu, C., & Tang, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123289 · Cited by 260
Self-citationMulti-Modal Fusion for End-to-End RGB-T Tracking
Zhang, L., Danelljan, M., Gonzalez-Garcia, A., van de Weijer, J., & Shahbaz Khan, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00278 · Cited by 212
Object fusion tracking based on visible and infrared images: A comprehensive review
Zhang, X., Ye, P., Leung, H., Gong, K., & Xiao, G. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.05.002 · Cited by 208
Cross-Modal Pattern-Propagation for RGB-T Tracking
Wang, C., Xu, C., Cui, Z., Zhou, L., Zhang, T., Zhang, X., & Yang, J. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00709 · Cited by 197
Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
Zhang, P., Zhao, J., Bo, C., Wang, D., Lu, H., & Yang, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060862 · Cited by 196
RGBT Tracking via Multi-Adapter Network with Hierarchical Divergence Loss
Lu, A., Li, C., Yan, Y., Tang, J., & Luo, B. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3087341 · Cited by 191
Self-citationContent-Aware Unsupervised Deep Homography Estimation
Zhang, J., Wang, C., Liu, S., Jia, L., Ye, N., Wang, J., Zhou, J., & Sun, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_38 · Cited by 190
Quality-Aware Feature Aggregation Network for Robust RGBT Tracking
Zhu, Y., Li, C., Tang, J., & Luo, B. (2021) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.2980735 · Cited by 188
Self-citationDense Feature Aggregation and Pruning for RGBT Tracking
Zhu, Y., Li, C., Luo, B., Tang, J., & Wang, X. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350928 · Cited by 185
Self-citationSynthetic Data Generation for End-to-End Thermal Infrared Tracking
Zhang, L., Gonzalez-Garcia, A., van de Weijer, J., Danelljan, M., & Khan, F. S. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2879249 · Cited by 183
Cross-Modal Ranking with Soft Consistency and Noisy Labels for Robust RGB-T Tracking
Li, C., Zhu, C., Huang, Y., Tang, J., & Wang, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_49 · Cited by 182
Self-citationLi, C. L., Lu, A., Zheng, A. H., Tu, Z., & Tang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00279 · Cited by 180
Self-citationUnsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation
Arar, M., Ginger, Y., Danon, D., Bermano, A. H., & Cohen-Or, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01342 · Cited by 175
Deep Adaptive Fusion Network for High Performance RGBT Tracking
Gao, Y., Li, C., Zhu, Y., Tang, J., He, T., & Wang, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00017 · Cited by 172
Self-citationObject Tracking in RGB-T Videos Using Modal-Aware Attention Network and Competitive Learning
Zhang, H., Zhang, L., Li, Z., & Zhang, J. (2020) · Sensors · doi:10.3390/s20020393 · Cited by 163
Duality-Gated Mutual Condition Network for RGBT Tracking
Lu, A., Qian, C., Li, C., Tang, J., & Wang, L. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3157594 · Cited by 163
Self-citationDeep Homography Estimation for Dynamic Scenes
Le, H. M., Liu, F., Zhang, S., & Agarwala, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00767 · Cited by 162
Li, C., Liu, L., Lu, A., Ji, Q., & Tang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_14 · Cited by 162
Self-citationTorabi, A., Massé, G., & Bilodeau, G.-A. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2011.10.006 · Cited by 161
RGBT Tracking by Trident Fusion Network
Zhu, Y., Li, C., Tang, J., Luo, B., & Wang, L. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3067997 · Cited by 152
Self-citationFusing two-stream convolutional neural networks for RGB-T object tracking
Li, C., Wu, X., Zhao, N., Cao, X., & Tang, J. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.11.068 · Cited by 131
Self-citationSiamFT: An RGB-Infrared Fusion Tracking Method via Fully Convolutional Siamese Networks
Zhang, X., Ye, P., Peng, S., Liu, J., Gong, K., & Xiao, G. (2019) · IEEE Access · doi:10.1109/access.2019.2936914 · Cited by 127
Learning Modality-Consistency Feature Templates: A Robust RGB-Infrared Tracking System
Lan, X., Ye, M., Shao, R., Zhong, B., Yuen, P. C., & Zhou, H. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2898618 · Cited by 124
Modality-correlation-aware sparse representation for RGB-infrared object tracking
Lan, X., Ye, M., Zhang, S., Zhou, H., & Yuen, P. C. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.10.002 · Cited by 121
Zhang, X., Ye, P., Peng, S., Liu, J., & Xiao, G. (2020) · Signal Processing Image Communication · doi:10.1016/j.image.2019.115756 · Cited by 112
Multimodal Cross-Layer Bilinear Pooling for RGBT Tracking
Xu, Q., Mei, Y., Liu, J., & Li, C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3055362 · Cited by 109
Self-citationChoi, H., Kim, S., Park, K., & Sohn, K. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899703 · Cited by 101
Dual-Stream Pyramid Registration Network
Hu, X., Kang, M., Huang, W., Scott, M. R., Wiest, R., & Reyes, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_43 · Cited by 101
M5L: Multi-Modal Multi-Margin Metric Learning for RGBT Tracking
Tu, Z., Lin, C., Zhao, W., Li, C., & Tang, J. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3125504 · Cited by 98
Self-citationCAMEL Dataset for Visual and Thermal Infrared Multiple Object Detection and Tracking
Gebhardt, E., & Wolf, M. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639094 · Cited by 77
Grayscale-Thermal Object Tracking via Multitask Laplacian Sparse Representation
Li, C., Sun, X., Wang, X., Zhang, L., & Tang, J. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2627052 · Cited by 76
Self-citationRobust Collaborative Discriminative Learning for RGB-Infrared Tracking
Lan, X., Ye, M., Zhang, S., & Yuen, P. C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12307 · Cited by 76
Fast RGB-T Tracking via Cross-Modal Correlation Filters
Zhai, S., Shao, P., Liang, X., & Wang, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.022 · Cited by 68
Luo, C., Sun, B., Yang, K., Lu, T., & Yeh, W. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.04.017 · Cited by 67
ViTBAT: Video tracking and behavior annotation tool
Biresaw, T. A., Nawaz, T. H., Ferryman, J. M., & Dell, A. I. (2016) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2016.7738055 · Cited by 60
Fourier Lucas-Kanade Algorithm
Lucey, S., Navarathna, R., Ashraf, A. B., & Sridharan, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.220 · Cited by 58
Zhang, X., Ye, P., Qiao, D., Zhao, J., Peng, S., & Xiao, G. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011253 · Cited by 54
Gündoğdu, E., Özkan, H., Demir, H. S., Ergezer, H., Akagündüz, E., & Pakin, S. K. (2015) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301290 · Cited by 53
RGBT Tracking via Noise-Robust Cross-Modal Ranking
Li, C., Xiang, Z., Tang, J., Luo, B., & Wang, F. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3067107 · Cited by 47
Self-citationLearning Soft-Consistent Correlation Filters for RGB-T Object Tracking
Wang, Y., Li, C., & Tang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03341-5_25 · Cited by 43
Self-citationReal-Time Grayscale-Thermal Tracking via Laplacian Sparse Representation
Li, C., Hu, S., Gao, S., & Tang, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27674-8_6 · Cited by 38
Self-citationLearning Multi-Domain Convolutional Network for RGB-T Visual Tracking
Zhang, X., Zhang, X., Du, X., Zhou, X., & Yin, J. (2018) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2018.8633180 · Cited by 33
Two-stage modality-graphs regularized manifold ranking for RGB-T tracking
Li, C., Zhu, C., Zheng, S., Luo, B., & Tang, J. P. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.08.004 · Cited by 31
Self-citationDiscriminative Fusion Correlation Learning for Visible and Infrared Tracking
Yun, X., Sun, Y., Yang, X., & Lu, N. (2019) · Mathematical Problems in Engineering · doi:10.1155/2019/2437521 · Cited by 31
Online Non-Negative Multi-Modality Feature Template Learning for RGB-Assisted Infrared Tracking
Lan, X., Ye, M., Shao, R., Zhong, B., Jain, D. K., & Zhou, H. (2019) · IEEE Access · doi:10.1109/access.2019.2916895 · Cited by 29
Xu, N., Xiao, G., Zhang, X., & Bavirisetti, D. P. (2018) · International Conference on Virtual Reality · doi:10.1145/3198910.3198918 · Cited by 21
HEASK: Robust homography estimation based on appearance similarity and keypoint correspondences
Yan, Q. Y., Xu, Y., Yang, X., & Nguyen, T. Q. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.007 · Cited by 16
Cited by
LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images
Li, H., Xu, T., Wu, X.-J., Lu, J., & Kittler, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3268209 · Cited by 493
Visible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
Visual Prompt Multi-Modal Tracking
Zhu, J., Lai, S., Chen, X., Wang, D., & Lu, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00918 · Cited by 349
Metadata
- Authors
- Li, C., Xue, W., Jia, Y., Qu, Z., Luo, B., Tang, J., & Sun, D.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2022
- Volume
- 31
- Pages
- 392-404
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3158472981
- Cited by
- 307
- References
- 63
- FWCI
- 9.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.