The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Structure-Aware Positional Transformer for Visible-Infrared Person Re-Identification
Abstract
Visible-infrared person re-identification (VI-ReID) is a cross-modality retrieval problem, which aims at matching the same pedestrian between the visible and infrared cameras. Due to the existence of pose variation, occlusion, and huge visual differences between the two modalities, previous studies mainly focus on learning image-level shared features. Since they usually learn a global representation or extract uniformly divided part features, these methods are sensitive to misalignments. In this paper, we propose a structure-aware positional transformer (SPOT) network to learn semantic-aware sharable modality features by utilizing the structural and positional information. It consists of two main components: attended structure representation (ASR) and transformer-based part interaction (TPI). Specifically, ASR models the modality-invariant structure feature for each modality and dynamically selects the discriminative appearance regions under the guidance of the structure information. TPI mines the part-level appearance and position relations with a transformer to learn discriminative part-level modality features. With a weighted combination of ASR and TPI, the proposed SPOT explores the rich contextual and structural information, effectively reducing cross-modality difference and enhancing the robustness against misalignments. Extensive experiments indicate that SPOT is superior to the state-of-the-art methods on two cross-modal datasets. Notably, the Rank-1/mAP value on the SYSU-MM01 dataset has improved by 8.43%/6.80%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)
Sun, Y., Zheng, L., Yang, Y., Tian, Q., & Wang, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_30 · Cited by 2,522
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
Self-citationTransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01474 · Cited by 1,244
Learning Discriminative Features with Multiple Granularities for Person Re-Identification
Wang, G., Yuan, Y., Chen, X., Li, J., & Zhou, X. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240552 · Cited by 1,203
RGB-Infrared Cross-Modality Person Re-identification
Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.575 · Cited by 862
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
End-to-End Video Instance Segmentation with Transformers
Wang, Y., Xu, Z., Wang, X., Shen, C., Cheng, B., Shen, H., & Xia, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00863 · Cited by 679
Pose-Guided Feature Alignment for Occluded Person Re-Identification
Miao, J., Wu, Y., Liu, P., Ding, Y., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00063 · Cited by 638
Pose-Invariant Embedding for Deep Person Re-Identification
Zheng, L., Huang, Y., Lu, H., & Yang, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2910414 · Cited by 583
RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment
Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., & Hou, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00372 · Cited by 559
Part-Aligned Bilinear Representations for Person Re-identification
Suh, Y., Wang, J., Tang, S., Mei, T., & Lee, K. M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_25 · Cited by 557
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification
Ye, M., Shen, J., J. Crandall, D., Shao, L., & Luo, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_14 · Cited by 523
Self-citationPedestrian Alignment Network for Large-scale Person Re-Identification
Zheng, Z., Zheng, L., & Yang, Y. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2873599 · Cited by 519
Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification
Wang, Z., Wang, Z., Zheng, Y., Chuang, Y.-Y., & Satoh, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00071 · Cited by 493
Infrared-Visible Cross-Modal Person Re-Identification with an X Modality
Li, D., Wei, X., Hong, X., & Gong, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5891 · Cited by 431
Cross-Modality Person Re-Identification With Shared-Specific Feature Transfer
Lu, Y., Wu, Y., Liu, B., Zhang, T., Li, B., Chu, Q., & Yu, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01339 · Cited by 418
Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Li, J., & Yuen, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12293 · Cited by 405
Self-citationChannel Augmented Joint Learning for Visible-Infrared Recognition
Ye, M., Ruan, W., Du, B., & Shou, M. Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01331 · Cited by 375
Self-citationHi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification
Choi, S., Lee, S., Kim, Y., Kim, T., & Kim, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01027 · Cited by 368
Rethinking Transformer-based Set Prediction for Object Detection
Sun, Z., Cao, S., Yang, Y., & Kitani, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00359 · Cited by 356
Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification
Wang, G.-A., Zhang, T., Yang, Y., Cheng, J., Chang, J., Liang, X., & Hou, Z.-G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6894 · Cited by 347
Robust Joint Graph Sparse Coding for Unsupervised Spectral Feature Selection
Zhu, X., Li, X., Zhang, S., Ju, C., & Wu, X. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2521602 · Cited by 339
Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification
Ye, M., Lan, X., Wang, Z., & Yuen, P. C. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2921454 · Cited by 331
Self-citationDiscover Cross-Modality Nuances for Visible-Infrared Person Re-Identification
Wu, Q., Dai, P., Chen, J., Lin, C.-W., Wu, Y., Huang, F., Zhong, B., & Ji, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00431 · Cited by 313
Self-citationUnsupervised Person Re-Identification via Softened Similarity Learning
Lin, Y., Xie, L., Wu, Y., Yan, C., & Tian, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00345 · Cited by 307
Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning
Ye, M., Shen, J., & Shao, L. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3001665 · Cited by 305
Self-citationPose-Guided Visible Part Matching for Occluded Person ReID
Gao, S., Wang, J., Lu, H., & Liu, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01176 · Cited by 296
Neural Feature Search for RGB-Infrared Person Re-Identification
Chen, Y., Wan, L., Li, Z., Jing, Q., & Sun, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00065 · Cited by 253
Liu, H., Tan, X., & Zhou, X. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3042080 · Cited by 241
Spatial-Temporal Graph Convolutional Network for Video-Based Person Re-Identification
Yang, J., Zheng, W.-S., Yang, Q., Chen, Y.-C., & Tian, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00335 · Cited by 238
Cross-Modality Person Re-Identification via Modality-Aware Collaborative Ensemble Learning
Ye, M., Lan, X., Leng, Q., & Shen, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2998275 · Cited by 235
Self-citationLearning to Adapt Invariance in Memory for Person Re-identification
Zhong, Z., Zheng, L., Luo, Z., Li, S., & Yang, Y. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2976933 · Cited by 197
Long-Term Cloth-Changing Person Re-identification
Qian, X., Wang, W., Zhang, L., Zhu, F., Fu, Y., Xiang, T., Jiang, Y.-G., & Xue, X. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-69535-4_5 · Cited by 189
Pose-Guided Multi-Granularity Attention Network for Text-Based Person Search
Jing, Y., Si, C., Wang, J., Wang, W., Wang, L., & Tan, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6777 · Cited by 179
Interpretable learning based Dynamic Graph Convolutional Networks for Alzheimer’s Disease analysis
Zhu, Y., Ma, J., Yuan, C., & Zhu, X. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.07.013 · Cited by 178
RGB-IR Person Re-identification by Cross-Modality Similarity Preservation
Wu, A., Zheng, W.-S., Gong, S., & Lai, J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01290-1 · Cited by 172
Trear: Transformer-Based RGB-D Egocentric Action Recognition
Li, X., Hou, Y., Wang, P., Gao, Z., Xu, M., & Li, W. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3048883 · Cited by 125
Flexible Body Partition-Based Adversarial Learning for Visible Infrared Person Re-Identification
Wei, Z., Yang, X., Wang, N., & Gao, X. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3059713 · Cited by 125
Pu, N., Chen, W., Liu, Y., Bakker, E. M., & Lew, M. S. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413673 · Cited by 123
Spatial-Temporal Attention-Aware Learning for Video-Based Person Re-Identification
Chen, G., Lu, J., Yang, M., & Zhou, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2908062 · Cited by 113
Pose-Guided Representation Learning for Person Re-Identification
Li, J., Zhang, S. S., Tian, Q., Wang, M., & Gao, W. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929036 · Cited by 111
SDL: Spectrum-Disentangled Representation Learning for Visible-Infrared Person Re-Identification
Kansal, K., Subramanyam, A. V., Wang, Z., & Satoh, S. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2963721 · Cited by 109
Bi-Directional Exponential Angular Triplet Loss for RGB-Infrared Person Re-Identification
Ye, H., Liu, H., Meng, F., & Li, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3045261 · Cited by 88
Dual-alignment Feature Embedding for Cross-modality Person Re-identification
Yi, H., Wang, N., Gao, X., et al. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351006 · Cited by 85
Half-Quadratic Minimization for Unsupervised Feature Selection on Incomplete Data
Shen, H. T., Zhu, Y., Zheng, W., & Zhu, X. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009632 · Cited by 79
Joint prediction and time estimation of COVID-19 developing severe symptoms using chest CT scan
Zhu, X., Song, B., Shi, F., Chen, Y., Hu, R., Gan, J., Zhang, W., Li, M., Wang, L., Gao, Y., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101824 · Cited by 75
Huang, N., Liu, J., Luo, Y., Zhang, Q., & Han, J. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109145 · Cited by 72
Alleviating Modality Bias Training for Infrared-Visible Person Re-Identification
Huang, Y., Wu, Q., Xu, J., Zhong, Y., Zhang, P., & Zhang, Z. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3067760 · Cited by 66
Multi-Band Brain Network Analysis for Functional Neuroimaging Biomarker Identification
Hu, R., Peng, Z., Zhu, X., Gan, J., Zhu, Y., Ma, J., & Guorong Wu, A. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3099641 · Cited by 57
An End-to-End Foreground-Aware Network for Person Re-Identification
Liu, Y., Zhou, W., Liu, J., Qi, G.-J., Tian, Q. C., & Li, H. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3050839 · Cited by 55
Zhang, H., Cao, H., Yang, X., Deng, C. D., & Tao, D. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3082298 · Cited by 54
Zhang, P., Xu, J., Wu, Q., et al. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2939564 · Cited by 39
Batch Coherence-Driven Network for Part-Aware Person Re-Identification
Wang, K., Wang, P., Ding, C., & Tao, D. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060909 · Cited by 35
Pose Guided Gated Fusion for Person Re-identification
Bhuiyan, A., Liu, Y., Siva, P., Javan, M., Ayed, I. B., & Granger, É. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093370 · Cited by 30
Person Re-Identification Via Pose-Aware Multi-Semantic Learning
Luo, X., Duong, H. K. L., & Liu, W. (2020) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102719 · Cited by 8
Metadata
- Authors
- Chen, C., Ye, M., Qi, M., Wu, J., Jiang, J., & Lin, C.-W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2022
- Volume
- 31
- Pages
- 2352-2364
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W4214891830
- Cited by
- 255
- References
- 59
- FWCI
- 17.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.