Learning Progressive Modality-Shared Transformers for Effective Visible-Infrared Person Re-identification
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Visible-Infrared Person Re-Identification (VI-ReID) is a challenging retrieval task under complex modality changes. Existing methods usually focus on extracting discriminative visual features while ignoring the reliability and commonality of visual features between different modalities. In this paper, we propose a novel deep learning framework named Progressive Modality-shared Transformer (PMT) for effective VI-ReID. To reduce the negative effect of modality gaps, we first take the gray-scale images as an auxiliary modality and propose a progressive learning strategy. Then, we propose a Modality-Shared Enhancement Loss (MSEL) to guide the model to explore more reliable identity information from modality-shared features. Finally, to cope with the problem of large intra-class differences and small inter-class differences, we propose a Discriminative Center Loss (DCL) combined with the MSEL to further improve the discrimination of reliable features. Extensive experiments on SYSU-MM01 and RegDB datasets show that our proposed framework performs better than most state-of-the-art methods. For model reproduction, we release the source code at https://github.com/hulu88/PMT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
TransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01474 · Cited by 1,244
A Discriminatively Learned CNN Embedding for Person Reidentification
Zheng, Z., Zheng, L., & Yang, Y. (2018) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3159171 · Cited by 874
RGB-Infrared Cross-Modality Person Re-identification
Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.575 · Cited by 862
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment
Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., & Hou, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00372 · Cited by 559
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification
Ye, M., Shen, J., J. Crandall, D., Shao, L., & Luo, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_14 · Cited by 523
Infrared-Visible Cross-Modal Person Re-Identification with an X Modality
Li, D., Wei, X., Hong, X., & Gong, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5891 · Cited by 431
Cross-Modality Person Re-Identification with Generative Adversarial Training
Dai, P., Ji, R., Wang, H., Wu, Q., & Huang, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/94 · Cited by 425
Cross-Modality Person Re-Identification With Shared-Specific Feature Transfer
Lu, Y., Wu, Y., Liu, B., Zhang, T., Li, B., Chu, Q., & Yu, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01339 · Cited by 418
Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Li, J., & Yuen, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12293 · Cited by 405
Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification
Choi, S., Lee, S., Kim, Y., Kim, T., & Kim, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01027 · Cited by 368
Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning
Ye, M., Shen, J., & Shao, L. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3001665 · Cited by 305
Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences
Park, H., Lee, S., Lee, J., & Ham, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01183 · Cited by 295
FMCNet: Feature-Level Modality Compensation for Visible-Infrared Person Re-Identification
Zhang, Q., Lai, C., Liu, J., Huang, N., & Han, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00720 · Cited by 279
Structure-Aware Positional Transformer for Visible-Infrared Person Re-Identification
Chen, C., Ye, M., Qi, M., Wu, J., Jiang, J., & Lin, C.-W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3141868 · Cited by 255
Neural Feature Search for RGB-Infrared Person Re-Identification
Chen, Y., Wan, L., Li, Z., Jing, Q., & Sun, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00065 · Cited by 253
Hetero-Center loss for cross-modality person Re-identification
Zhu, Y., Yang, Z., Wang, L., Zhao, S., Hu, X., & Tao, D. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.100 · Cited by 222
Cross-Modality Person Re-Identification via Modality Confusion and Center Aggregation
Hao, X., Zhao, S., Ye, M., & Shen, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01609 · Cited by 214
AAformer: Auto-Aligned Transformer for Person Re-Identification
Zhu, K., Guo, H., Zhang, S., Wang, Y., Liu, J., Wang, J., & Tang, M. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3301856 · Cited by 193
CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification
Fu, C., Hu, Y., Wu, X., Shi, H., Mei, T., & He, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01161 · Cited by 174
RGB-IR Person Re-identification by Cross-Modality Similarity Preservation
Wu, A., Zheng, W.-S., Gong, S., & Lai, J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01290-1 · Cited by 172
HAT: Hierarchical Aggregation Transformers for Person Re-identification
Zhang, G., Zhang, P., Qi, J., & Lu, H. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475202 · Cited by 161
Self-citationCross-Modality Transformer With Modality Mining for Visible-Infrared Person Re-Identification
Liang, T., Jin, Y., Liu, W., & Li, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3237155 · Cited by 155
Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-identification
Huang, Z., Liu, J., Li, L., Zheng, K., & Zha, Z.-J. (2022) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v36i1.19987 · Cited by 138
MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification
Gao, Y., Liang, T., Jin, Y., Gu, X., Liu, W., Li, Y., & Lang, C. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475643 · Cited by 99
Pose-guided Inter- and Intra-part Relational Transformer for Occluded Person Re-Identification
Ma, Z., Zhao, Y., & Li, J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475283 · Cited by 89
TransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04378 · Cited by 82
Zhang, L., Du, G., Liu, F., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3085978 · Cited by 74
Transformer Meets Part Model: Adaptive Part Division for Person Re-Identification
Lai, S., Chai, Z., & Wei, X. K. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00461 · Cited by 63
OH-Former: Omni-Relational High-Order Transformer for Person Re-IdentificationPreprint
Chen, X., Xu, C., Cao, Q., Xu, J., Zhong, Y., Xu, J., Li, Z., Wang, J., & Gao, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.11159 · Cited by 35
Metadata
- Authors
- Lu, H., Zou, X., & Zhang, P.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2023-06-26
- Volume
- 37
- Issue
- 2
- Pages
- 1835-1843
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W4382467684
- Cited by
- 190
- References
- 38
- FWCI
- 21.60
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.