The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Channel Augmented Joint Learning for Visible-Infrared Recognition
Abstract
This paper introduces a powerful channel augmented joint learning strategy for the visible-infrared recognition problem. For data augmentation, most existing methods directly adopt the standard operations designed for single-modality visible images, and thus do not fully consider the imagery properties in visible to infrared matching. Our basic idea is to homogenously generate color-irrelevant images by randomly exchanging the color channels. It can be seamlessly integrated into existing augmentation operations without modifying the network, consistently improving the robustness against color variations. Incorporated with a random erasing strategy, it further greatly enriches the diversity by simulating random occlusions. For cross-modality metric learning, we design an enhanced channel-mixed learning strategy to simultaneously handle the intra-and cross-modality variations with squared difference for stronger discriminability. Besides, a channel-augmented joint learning strategy is further developed to explicitly optimize the outputs of augmented images. Extensive experiments with insightful analysis on two visible-infrared recognition tasks show that the proposed strategies consistently improve the accuracy. Without auxiliary information, it improves the state-of-the-art Rank-1/mAP by 14.59%/13.00% on the large-scale SYSU-MM01 dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617 · cited 2×
“The random erasing [59] is applied in many fine-grained recognition problems for better generalizability.”
BackgroundCosFace: Large Margin Cosine Loss for Deep Face Recognition
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00552 · Cited by 3,034
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
Self-citationUnsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
A Light CNN for Deep Face Representation With Noisy Labels
Wu, X., He, R., Sun, Z., & Tan, T. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2833032 · Cited by 1,186
Circle Loss: A Unified Perspective of Pair Similarity Optimization
Sun, Y., Cheng, C., Zhang, Y., Zhang, C., Zheng, L., Wang, Z., & Wei, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00643 · Cited by 987
Person Re-identification: Past, Present and Future
Zheng, L., Yang, Y. P., & Hauptmann, A. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02984 · Cited by 922
RGB-Infrared Cross-Modality Person Re-identification
Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.575 · Cited by 862
Multi-Similarity Loss With General Pair Weighting for Deep Metric Learning
Wang, X., Han, X., Huang, W., Dong, D., & Scott, M. R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00516 · Cited by 854
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment
Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., & Hou, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00372 · Cited by 559
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification
Ye, M., Shen, J., J. Crandall, D., Shao, L., & Luo, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_14 · Cited by 523
Self-citationLearning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification
Wang, Z., Wang, Z., Zheng, Y., Chuang, Y.-Y., & Satoh, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00071 · Cited by 493
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
Infrared-Visible Cross-Modal Person Re-Identification with an X Modality
Li, D., Wei, X., Hong, X., & Gong, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5891 · Cited by 431
Pyramidal Person Re-IDentification via Multi-Loss Dynamic Training
Zheng, F., Deng, C., Sun, X., Jiang, X., Guo, X., Yu, Z., Huang, F., & Ji, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00871 · Cited by 428
Cross-Modality Person Re-Identification with Generative Adversarial Training
Dai, P., Ji, R., Wang, H., Wu, Q., & Huang, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/94 · Cited by 425
Cross-Modality Person Re-Identification With Shared-Specific Feature Transfer
Lu, Y., Wu, Y., Liu, B., Zhang, T., Li, B., Chu, Q., & Yu, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01339 · Cited by 418
Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Li, J., & Yuen, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12293 · Cited by 405
Self-citationCross-Modal Retrieval With CNN Visual Features: A New Baseline
Wei, Y., Zhao, Y., Lu, C., Wei, S., Liu, L., Zhu, Z., & Yan, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2519449 · Cited by 370
Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification
Choi, S., Lee, S., Kim, Y., Kim, T., & Kim, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01027 · Cited by 368
Heterogeneous Face Recognition Using Kernel Prototype Similarities
Klare, B. F., & Jain, A. K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.229 · Cited by 362
Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Wang, Z., & Yuen, P. C. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2921454 · Cited by 331
Self-citationScalable Person Re-identification on Supervised Smoothed Manifold
Bai, S., Bai, X., & Tian, Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.358 · Cited by 320
Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning
Ye, M., Shen, J., & Shao, L. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3001665 · Cited by 305
Self-citationCamStyle: A Novel Data Augmentation Method for Person Re-Identification
Zhong, Z., Zheng, L., Zheng, Z., Li, S., & Yang, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2874313 · Cited by 303
Learning Modality-Specific Representations for Visible-Infrared Person Re-Identification
Feng, Z., Lai, J., & Xie, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928126 · Cited by 291
HSME: Hypersphere Manifold Embedding for Visible Thermal Person Re-Identification
Hao, Y., Wang, N., Li, J., & Gao, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018385 · Cited by 281
Cross-Modality Binary Code Learning via Fusion Similarity Hashing
Liu, H., Ji, R., Wu, Y., Huang, F., & Zhang, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.672 · Cited by 251
VRSTC: Occlusion-Free Video Person Re-Identification
Hou, R., Ma, B., Chang, H., Gu, X., Shan, S., & Chen, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00735 · Cited by 234
Huang, D.-A., & Wang, Y.-C. F. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.310 · Cited by 175
RGB-IR Person Re-identification by Cross-Modality Similarity Preservation
Wu, A., Zheng, W.-S., Gong, S., & Lai, J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01290-1 · Cited by 172
Learning Invariant Deep Representation for NIR-VIS Face Recognition
He, R., Wu, X., Sun, Z., & Tan, T. N. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10786 · Cited by 168
Learning mappings for face synthesis from near infrared to visual light images
Chen, J., Yi, D., Yang, J., Zhao, G., Li, S. Z., & Pietikäinen, M. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206832 · Cited by 146
Coupled Deep Learning for Heterogeneous Face Recognition
Wu, X., Song, L., He, R., & Tan, T. N. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11500 · Cited by 119
COCAS: A Large-Scale Clothes Changing Person Dataset for Re-Identification
Yu, S., Li, S., Chen, D., Zhao, R., Yan, J., & Qiao, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00346 · Cited by 110
Universal Weighting Metric Learning for Cross-Modal Matching
Wei, J., Xu, X., Yang, Y., Ji, Y., Wang, Z., & Shen, H. T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01302 · Cited by 110
Disentangled Variational Representation for Heterogeneous Face Recognition
Wu, X., Huang, H., Patel, V. M., He, R., & Sun, Z. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019005 · Cited by 100
Zhang, H., Riggan, B. S., Hu, S., Short, N. J., & Patel, V. M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01175-3 · Cited by 85
Wang, G., Lai, J., Liang, W., & Wang, G. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01058 · Cited by 82
Beyond Intra-modality: A Survey of Heterogeneous Person Re-identification
Wang, Z., Wang, Z., Zheng, Y., Wu, Y., Zeng, W., & Satoh, S. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/692 · Cited by 80
Cross-Spectral Face Hallucination via Disentangling Independent Factors
Duan, B., Fu, C., Li, Y., Song, X., & He, R. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00795 · Cited by 78
Person Re-Identification by Context-Aware Part Attention and Multi-Head Collaborative Learning
Wu, D., Ye, M., Lin, G., Gao, X., & Shen, J. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3075894 · Cited by 75
Self-citationRe-Ranking High-Dimensional Deep Local Representation for NIR-VIS Face Recognition
Peng, C., Wang, N., Li, J., & Gao, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2912360 · Cited by 49
Non-Local Intrinsic Decomposition With Near-Infrared Priors
Cheng, Z., Zheng, Y., You, S., & Sato, I. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00261 · Cited by 37
WePerson: Learning a Generalized Re-identification Model from All-weather Virtual Data
Li, H., Ye, M., & Du, B. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475455 · Cited by 34
Self-citation
Cited by
Zhang, Y., & Wang, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00214 · Cited by 322
Structure-Aware Positional Transformer for Visible-Infrared Person Re-Identification
Chen, C., Ye, M., Qi, M., Wu, J., Jiang, J., & Lin, C.-W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3141868 · Cited by 255
Self-citation
Metadata
- Authors
- Ye, M., Ruan, W., Du, B., & Shou, M. Z.
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 13547-13556
- OpenAlex
- W3204075450
- Cited by
- 375
- References
- 56
- FWCI
- 16.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.