The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline
Open accessAbstract
With the popularity of multi-modal sensors, visible-thermal (RGB-T) object tracking is to achieve robust performance and wider application scenarios with the guidance of objects' temperature information. However, the lack of paired training samples is the main bottleneck for unlocking the power of RGB-T tracking. Since it is laborious to collect high-quality RGB-T sequences, recent benchmarks only provide test sequences. In this paper, we construct a large-scale benchmark with high diversity for visible-thermal UAV tracking (VTUAV), including 500 sequences with 1.7 million high-resolution (1920* 1080 pixels) frame pairs. In addition, comprehensive applications (short-term tracking, long-term tracking and segmentation mask prediction) with diverse categories and scenes are considered for exhaustive evaluation. Moreover, we provide a coarse-to-fine attribute annotation, where frame-level attributes are provided to exploit the potential of challenge-specific trackers. In addition, we design a new RGB-T baseline, named Hierarchical Multi-modal Fusion Tracker (HMFT), which fuses RGB-T data in various levels. Numerous experiments on several datasets are conducted to reveal the effectiveness of HMFT and the complement of different fusion types. The project is available at here.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Fully-Convolutional Siamese Networks for Object Tracking
Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · cited 1×
“However, existing visual and RGB-T datasets [20, 26, 40] label attributes at the sequencelevel, which involves various challenges into single sequence in a coarse manner.”
BackgroundHigh Performance Visual Tracking with Siamese Region Proposal Network
Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00935 · Cited by 3,023
ECO: Efficient Convolution Operators for Tracking
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.733 · Cited by 2,805
SiamRPN++: Evolution of Siamese Visual Tracking With Very Deep Networks
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., & Yan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00441 · Cited by 2,607
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Van Gool, L., Gross, M., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.85 · Cited by 1,989
A Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
ATOM: Accurate Tracking by Overlap Maximization
Danelljan, M., Bhat, G., Khan, F. S., & Felsberg, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00479 · Cited by 1,591
Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00803 · Cited by 1,588 · cited 5×
“We evaluate numerous popular short-term and longterm RGB trackers with various frameworks on VTUAVV dataset, including, LTMU [6], STARK [42], TransT [5], DiMP [2], SiamRPN++ [17], ATOM [8], LightTrack [43], Ocean [52], SiamRPN [18], SiamTPN [41], SiamAPN++ [4], ECO [7], D3S [29], RTMDNet [14], HiFT [3], SPLT [44], Sia…”
MethodInfluentialSelf-citationLearning Discriminative Model Prediction for Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00628 · Cited by 1,515
Learning Spatio-Temporal Transformer for Visual Tracking
Yan, B., Peng, H., Fu, J., Wang, D., & Lu, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01028 · Cited by 1,280 · cited 7×
“STARK achieves the top performance with 64.9% and 75.3% in SR and PR, respectively.”
MethodInfluentialSelf-citationTrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_19 · Cited by 1,192
Acquisition of Localization Confidence for Accurate Object Detection
Jiang, B., Luo, R., Mao, J., Xiao, T., & Jiang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_48 · Cited by 1,059
Ocean: Object-Aware Anchor-Free Tracking
Zhang, Z., Peng, H., Fu, J., Li, B., & Hu, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_46 · Cited by 894
RGB-T object tracking: Benchmark and baseline
Li, C., Liang, X., Lu, Y., Zhao, N., & Tang, J. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106977 · Cited by 581
The Seventh Visual Object Tracking VOT2019 Challenge Results
Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Pflugfelder, R., Kamarainen, J.-K., Zajc, L. C., Drbohlav, O., Lukezic, A., Berg, A., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00276 · Cited by 461
Self-citationBackground-subtraction using contour-based fusion of thermal and visible imagery
Davis, J. W., & Sharma, V. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.06.010 · Cited by 418
Visual Object Tracking for Unmanned Aerial Vehicles: A Benchmark and New Motion Models
Li, S., & Yeung, D.-Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11205 · Cited by 394
Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking
Li, C., Cheng, H., Hu, S., Liu, X., Tang, J., & Lin, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2614135 · Cited by 391
HiFT: Hierarchical Feature Transformer for Aerial Tracking
Cao, Z., Fu, C., Ye, J., Li, B., & Li, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01517 · Cited by 325
High-Performance Long-Term Tracking With Meta-Updater
Dai, K., Zhang, Y., Wang, D., Li, J., Lu, H., & Yang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00633 · Cited by 310
Self-citationD3S – A Discriminative Single Shot Segmentation Tracker
Lukezic, A., Matas, J., & Kristan, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00716 · Cited by 300
GlobalTrack: A Simple and Strong Baseline for Long-Term Tracking
Huang, L., Zhao, X., & Huang, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6758 · Cited by 279
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Yan, B., Peng, H., Wu, K., Wang, D., Fu, J., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01493 · Cited by 277
Self-citationWeighted Sparse Representation Regularized Graph Learning for RGB-T Object Tracking
Li, C., Zhao, N., Lu, Y., Zhu, C., & Tang, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123289 · Cited by 260
The Eighth Visual Object Tracking VOT2020 Challenge Results
Kristan, M., Leonardis, A., Matas, J., Felsberg, M., Pflugfelder, R., Kämäräinen, J.-K., Danelljan, M., Zajc, L. Č., Lukežič, A., Drbohlav, O., et al. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68238-5_39 · Cited by 259
Self-citation‘Skimming-Perusal’ Tracking: A Framework for Real-Time and Robust Long-Term Tracking
Yan, B., Zhao, H., Wang, D., Lu, H., & Yang, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00247 · Cited by 218
Self-citationMulti-Modal Fusion for End-to-End RGB-T Tracking
Zhang, L., Danelljan, M., Gonzalez-Garcia, A., van de Weijer, J., & Shahbaz Khan, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00278 · Cited by 212
Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
Zhang, P., Zhao, J., Bo, C., Wang, D., Lu, H., & Yang, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060862 · Cited by 196
Self-citationDense Feature Aggregation and Pruning for RGBT Tracking
Zhu, Y., Li, C., Luo, B., Tang, J., & Wang, X. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350928 · Cited by 185
Learning Adaptive Attribute-Driven Representation for Real-Time RGB-T Tracking
Zhang, P., Wang, D., Lu, H., & Yang, X. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01495-3 · Cited by 184
Self-citationLi, C. L., Lu, A., Zheng, A. H., Tu, Z., & Tang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00279 · Cited by 180
SiamAPN++: Siamese Attentional Aggregation Network for Real-Time UAV Tracking
Cao, Z., Fu, C., Ye, J., Li, B., & Li, Y. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636309 · Cited by 173
Deep Adaptive Fusion Network for High Performance RGBT Tracking
Gao, Y., Li, C., Zhu, Y., Tang, J., He, T., & Wang, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00017 · Cited by 172
Vision Meets Drones: Past, Present and FuturePreprint
Zhu, P., Wen, L., Du, D., Bian, X., Hu, Q., & Ling, H. (2020) · arXiv (Cornell University) · Cited by 164
Cross-Modal Pattern-Propagation for RGB-T Tracking
Wang, C., Xu, C., Cui, Z., Zhou, L., Zhang, T., Zhang, X., & Yang, J. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00709 · Cited by 162
Li, C., Liu, L., Lu, A., Ji, Q., & Tang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_14 · Cited by 162
SiamCDA: Complementarity- and Distractor-Aware RGB-T Tracking Based on Siamese Network
Zhang, T., Liu, X., Zhang, Q., & Han, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3072207 · Cited by 162
Torabi, A., Massé, G., & Bilodeau, G.-A. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2011.10.006 · Cited by 161
Object Tracking in RGB-T Videos Using Modal-Aware Attention Network and Competitive Learning
Zhang, H., Zhang, L., Li, Z., & Zhang, J. (2020) · Sensors · doi:10.3390/s20020393 · Cited by 145
Siamese Transformer Pyramid Networks for Real-Time UAV Tracking
Xing, D., Evangeliou, N., Τσουκαλάς, Α., & Tzes, A. P. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00196 · Cited by 143
Fusing two-stream convolutional neural networks for RGB-T object tracking
Li, C., Wu, X., Zhao, N., Cao, X., & Tang, J. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.11.068 · Cited by 131
MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking
Wang, X., Shu, X., Zhang, S. S., Jiang, B., Wang, Y., Tian, Y., & Wu, F. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3174341 · Cited by 85
Luo, C., Sun, B., Yang, K., Lu, T., & Yeh, W. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.04.017 · Cited by 63
IVFuseNet: Fusion of infrared and visible light images for depth prediction
Li, Y., Zhao, H., Hu, Z., Wang, Q., & Chen, Y. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.12.014 · Cited by 63
Siamese infrared and visible light fusion network for RGB-T tracking
Peng, J., Zhao, H., Hu, Z., Zhuang, Y., & Wang, B. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-01833-6 · Cited by 63
Multi-modal visual tracking: Review and experimental comparison
Zhang, P., Wang, D., & Lu, H. (2024) · Computational Visual Media · doi:10.1007/s41095-023-0345-5 · Cited by 61
Self-citationLearning Attribute-Specific Representations for Visual Tracking
Qi, Y., Zhang, S., Zhang, W., Su, L., Huang, Q., & Yang, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018835 · Cited by 45
Learning Multi-Domain Convolutional Network for RGB-T Visual Tracking
Zhang, X., Zhang, X., Du, X., Zhou, X., & Yin, J. (2018) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2018.8633180 · Cited by 28
FANet: Quality-Aware Feature Aggregation Network for RGB-T Tracking.
Zhu, Y., Li, C., Lu, Y., Lin, L., Luo, B., & Tang, J. (2018) · Cited by 20
TracKlinic: Diagnosis of Challenge Factors in Visual Tracking
Fan, H., Yang, F., Chu, P., Lin, Y., Yuan, L., & Ling, H. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00101 · Cited by 19
Lu, H., & Wang, D. (2019) · doi:10.1007/978-981-13-0469-9 · Cited by 16
Self-citation
Cited by
Visible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
Visual Prompt Multi-Modal Tracking
Zhu, J., Lai, S., Chen, X., Wang, D., & Lu, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00918 · Cited by 349
Self-citation
Metadata
- Authors
- Zhang, P., Zhao, J., Wang, D., Lu, H., & Ruan, X.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 8876-8885
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312668764
- Cited by
- 278
- References
- 53
- FWCI
- 19.99
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.