The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
FMCNet: Feature-Level Modality Compensation for Visible-Infrared Person Re-Identification
Abstract
For Visible-Infrared person ReIDentification (VI-ReID), existing modality-specific information compensation based models try to generate the images of missing modality from existing ones for reducing cross-modality discrepancy. However, because of the large modality discrepancy between visible and infrared images, the generated images usually have low qualities and introduce much more interfering information (e.g., color inconsistency). This greatly degrades the subsequent VI-ReID performance. Alternatively, we present a novel Feature-level Modality Compensation Network (FMCNet) for VI-ReID in this paper, which aims to compensate the missing modality-specific information in the feature level rather than in the image level, i.e., directly generating those missing modality-specific features of one modality from existing modality-shared features of the other modality. This will enable our model to mainly generate some discriminative person related modality-specific features and discard those non-discriminative ones for benefiting VI-ReID. For that, a single-modality feature decomposition module is first designed to decompose single-modality features into modality-specific ones and modality-shared ones. Then, a feature-level modality compensation module is present to generate those missing modality-specific features from existing modality-shared ones. Finally, a shared-specific feature fusion module is proposed to combine the existing and generated features for VI-ReID. The effectiveness of our proposed model is verified on two benchmark datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)
Sun, Y., Zheng, L., Yang, Y., Tian, Q., & Wang, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_30 · Cited by 2,522
RGB-Infrared Cross-Modality Person Re-identification
Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.575 · Cited by 862
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
A Strong Baseline and Batch Normalization Neck for Deep Person Re-Identification
Luo, H., Jiang, W., Gu, Y., Liu, F., Liao, X., Lai, S., & Gu, J. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2958756 · Cited by 593
RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment
Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., & Hou, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00372 · Cited by 559
Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms
Moon, H., & Phillips, P. J. (2001) · Perception · doi:10.1068/p2896 · Cited by 509
Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification
Wang, Z., Wang, Z., Zheng, Y., Chuang, Y.-Y., & Satoh, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00071 · Cited by 493
Infrared-Visible Cross-Modal Person Re-Identification with an X Modality
Li, D., Wei, X., Hong, X., & Gong, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5891 · Cited by 431
Cross-Modality Person Re-Identification With Shared-Specific Feature Transfer
Lu, Y., Wu, Y., Liu, B., Zhang, T., Li, B., Chu, Q., & Yu, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01339 · Cited by 418
Visible Thermal Person Re-Identification via Dual-Constrained Top-Ranking
Ye, M., Wang, Z., Lan, X., et al. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/152 · Cited by 386
Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification
Choi, S., Lee, S., Kim, Y., Kim, T., & Kim, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01027 · Cited by 368
Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification
Wang, G.-A., Zhang, T., Yang, Y., Cheng, J., Chang, J., Liang, X., & Hou, Z.-G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6894 · Cited by 347
Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Wang, Z., & Yuen, P. C. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2921454 · Cited by 331
A Survey of Open-World Person Re-Identification
Leng, Q., Ye, M., & Tian, Q. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2898940 · Cited by 318
Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning
Ye, M., Shen, J., & Shao, L. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3001665 · Cited by 305
Learning Modality-Specific Representations for Visible-Infrared Person Re-Identification
Feng, Z., Lai, J., & Xie, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928126 · Cited by 291
HSME: Hypersphere Manifold Embedding for Visible Thermal Person Re-Identification
Hao, Y., Wang, N., Li, J., & Gao, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018385 · Cited by 281
Neural Feature Search for RGB-Infrared Person Re-Identification
Chen, Y., Wan, L., Li, Z., Jing, Q., & Sun, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00065 · Cited by 253
Deep learning-based methods for person re-identification: A comprehensive review
Wu, D., Zheng, S.-J., Zhang, X.-P., Yuan, C.-A., Cheng, F., Zhao, Y., Lin, Y.-J., Zhao, Z.-Q., Jiang, Y.-L., & Huang, D.-S. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.079 · Cited by 229
Grayscale Enhancement Colorization Network for Visible-Infrared Person Re-Identification
Zhong, X., Lu, T., Huang, W., Ye, M., Jia, X., & Lin, C.-W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3072171 · Cited by 183
CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification
Fu, C., Hu, Y., Wu, X., Shi, H., Mei, T., & He, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01161 · Cited by 174
Flexible Body Partition-Based Adversarial Learning for Visible Infrared Person Re-Identification
Wei, Z., Yang, X., Wang, N., & Gao, X. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3059713 · Cited by 125
SFANet: A Spectrum-Aware Feature Augmentation Network for Visible-Infrared Person Reidentification
Liu, H., Ma, S., Xia, D., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105702 · Cited by 112
SDL: Spectrum-Disentangled Representation Learning for Visible-Infrared Person Re-Identification
Kansal, K., Subramanyam, A. V., Wang, Z., & Satoh, S. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2963721 · Cited by 109
Cross-modality paired-images generation and augmentation for RGB-infrared person re-identification
Wang, G., Yang, Y., Zhang, T., Cheng, J., Hou, Z., Tiwari, P., & Pandey, H. M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.008 · Cited by 96
Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network
Ye, L., Rochan, M., Liu, Z., Zhang, X., & Wang, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054384 · Cited by 94
Liu, H., Chai, Y., Tan, X., et al. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3065903 · Cited by 72
RGB-IR cross-modality person ReID based on teacher-student GAN model
Zhang, Z., Jiang, S., Huang, C., Li, Y., & Xu, R. Y. D. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.07.006 · Cited by 71
Fan, X., Jiang, W., Luo, H., & Mao, W. (2022) · The Visual Computer · doi:10.1007/s00371-020-02015-z · Cited by 45
Visible-infrared cross-modality person re-identification based on whole-individual training
Sun, J., Li, Y., Chen, H., Peng, Y., Zhu, X., & Zhu, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.073 · Cited by 30
The Multi-Layer Constrained Loss for Cross-Modality Person Re-Identification
Sun, Z., Zhu, Y., Song, S., Hou, J., Du, S., & Song, Y. (2020) · International Conference on Artificial Intelligence and Signal Processing (AISP) · doi:10.1109/aisp48273.2020.9073293 · Cited by 8
Cited by
Zhang, Y., & Wang, H. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00214 · Cited by 322
Metadata
- Authors
- Zhang, Q., Lai, C., Liu, J., Huang, N., & Han, J.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 7339-7348
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312936309
- Cited by
- 279
- References
- 36
- FWCI
- 22.12
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.