The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
RGB-Infrared Cross-Modality Person Re-identification
Open accessAbstract
Person re-identification (Re-ID) is an important problem in video surveillance, aiming to match pedestrian images across camera views. Currently, most works focus on RGB-based Re-ID. However, in some applications, RGB images are not suitable, e.g. in a dark environment or at night. Infrared (IR) imaging becomes necessary in many visual systems. To that end, matching RGB images with infrared images is required, which are heterogeneous with very different visual characteristics. For person Re-ID, this is a very challenging cross-modality problem that has not been studied so far. In this work, we address the RGB-IR cross-modality Re-ID problem and contribute a new multiple modality Re-ID dataset named SYSU-MM01, including RGB and IR images of 491 identities from 6 cameras, giving in total 287,628 RGB images and 15,792 IR images. To explore the RGB-IR Re-ID problem, we evaluate existing popular cross-domain models, including three commonly used neural network structures (one-stream, two-stream and asymmetric FC layer) and analyse the relation between them. We further propose deep zero-padding for training one-stream network towards automatically evolving domain-specific nodes in the network for cross-modality matching. Our experiments show that RGB-IR cross-modality matching is very challenging but still feasible using the proposed model with deep zero-padding, giving the best performance. Our dataset is available at http:// isee.sysu.edu.cn/project/RGBIRReID.htm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
DeepReID: Deep Filter Pairing Neural Network for Person Re-identification
Li, W., Zhao, R., Xiao, T., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.27 · Cited by 2,611
DeViSE: A Deep Visual-Semantic Embedding Model
Frome, A., Corrado, G. S., Shlens, J., Samy Bengio, A., Dean, J., Ranzato, M., & Mikolov, T. (2013) · Cited by 2,308
Person re-identification by Local Maximal Occurrence representation and metric learning
Liao, S., Hu, Y., Zhu, X., & Li, S. Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298832 · Cited by 2,091
Large scale metric learning from equivalence constraints
Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247939 · Cited by 1,606
A new approach to cross-modal multimedia retrieval
Rasiwasia, N., Costa Pereira, J., Coviello, E., Doyle, G., Lanckriet, G. R. G., Levy, R., & Vasconcelos, N. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873987 · Cited by 1,334
An improved deep learning architecture for person re-identification
Ahmed, E., Jones, M., & Marks, T. K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299016 · Cited by 1,248
Evaluating Appearance Models for Recognition, Reacquisition, and Tracking
Gray, D. A., Brennan, S., & Hai, T. (2007) · Cited by 984
MARS: A Video Benchmark for Large-Scale Person Re-Identification
Zheng, L., Bie, Z., Sun, Y., Wang, J., Su, C., Wang, S., & Tian, Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_52 · Cited by 965
Person Re-identification by Descriptive and Discriminative Classification
Hirzer, M., Beleznai, C., Roth, P. M., & Bischof, H. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21227-7_9 · Cited by 961
Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification
Xiao, T., Li, H., Ouyang, W., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.140 · Cited by 958
Deep Fragment Embeddings for Bidirectional Image Sentence Mapping
Karpathy, A., Joulin, A., & Fei-Fei, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.5679 · Cited by 739
Gated Siamese Convolutional Neural Network Architecture for Human Re-identification
Varior, R. R., Haloi, M., & Wang, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_48 · Cited by 723
Reidentification by Relative Distance Comparison
Zheng, W.-S., Gong, S., & Xiang, T. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.138 · Cited by 719
Self-citationGeneralized Multiview Analysis: A discriminative latent space
Sharma, A., Kumar, A., Daume, H., & Jacobs, D. W. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247923 · Cited by 714
Custom Pictorial Structures for Re-identification
Cheng, D. S., Cristani, M., Stoppa, M., Bazzani, L., & Murino, V. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.68 · Cited by 616
Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization
Zhang, D., & Li, W.-J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8995 · Cited by 616
Human Reidentification with Transferred Metric Learning
Li, W., Zhao, R., & Wang, X. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37331-2_3 · Cited by 591
Semantics-preserving hashing for cross-view retrieval
Lin, Z., Ding, G., Hu, M., & Wang, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299011 · Cited by 542
Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms
Moon, H., & Phillips, P. J. (2001) · Perception · doi:10.1068/p2896 · Cited by 509
Salient Color Names for Person Re-identification
Yang, Y., Yang, J., Yan, J., Liao, S., Yi, D., & Li, S. Z. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_35 · Cited by 476
Learning Locally-Adaptive Decision Functions for Person Verification
Li, Z., Chang, S., Liang, F., Huang, T. S., Cao, L., & Smith, J. R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.463 · Cited by 466
Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation
Li, W., Duan, L., Xu, D., & Tsang, I. W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.167 · Cited by 449
Zheng, W.-S., Gong, S., & Xiang, T. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.23 · Cited by 444
Self-citationEfficient PSD Constrained Asymmetric Metric Learning for Person Re-Identification
Liao, S., & Li, S. Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.420 · Cited by 395
Joint Learning of Single-Image and Cross-Image Representations for Person Re-identification
Wang, F., Zuo, W., Lin, L., Zhang, D., & Zhang, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.144 · Cited by 389
Cross-Modal Retrieval With CNN Visual Features: A New Baseline
Wei, Y., Zhao, Y., Lu, C., Wei, S., Liu, L., Zhu, Z., & Yan, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2519449 · Cited by 370
Person Re-Identification by Camera Correlation Aware Feature Augmentation
Chen, Y.-C., Zhu, X., Zheng, W.-S., & Lai, J.-H. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2666805 · Cited by 339
Self-citationPartial Person Re-Identification
Zheng, W.-S., Li, X., Xiang, T., Liao, S., Lai, J., & Gong, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.531 · Cited by 295
Self-citationLinear cross-modal hashing for efficient multimedia search
Zhu, X., Huang, Z., Shen, H. T., & Zhao, X. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502107 · Cited by 282
Ma, B., Su, Y., & Jurie, F. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.002 · Cited by 254
A Comprehensive Survey on Cross-modal Retrieval
Wang, K., Yin, Q., Wang, W., Wu, S., & Wang, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.06215 · Cited by 208
Inter-modality Face Recognition
Lin, D., & Tang, X. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_2 · Cited by 204
An enhanced deep feature representation for person re-identification
Wu, S., Chen, Y.-C., Li, X., Wu, A.-C., You, J.-J., & Zheng, W.-S. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477681 · Cited by 198
Self-citationSupervised Coupled Dictionary Learning with Group Structures for Multi-modal Retrieval
Zhuang, Y., Wang, Y., Wu, F., Zhang, Y., & Lu, W. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8603 · Cited by 191
Multimodal Similarity-Preserving Hashing
Masci, J., Bronstein, M. M., Bronstein, A. M., & Schmidhuber, J. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.225 · Cited by 179
Learning Invariant Deep Representation for NIR-VIS Face Recognition
He, R., Wu, X., Sun, Z., & Tan, T. N. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10786 · Cited by 168
Multi-Scale Learning for Low-Resolution Person Re-Identification
Li, X., Zheng, W., Wang, X., Xiang, T., & Gong, S. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.429 · Cited by 163
Self-citationCoupled Spectral Regression for matching heterogeneous faces
Lei, Z., & Li, S. Z. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206860 · Cited by 162
Towards Open-World Person Re-Identification by One-Shot Group-Based Verification
Zheng, W.-S., Gong, S., & Xiang, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2453984 · Cited by 159
Self-citationCross-Domain Visual Matching via Generalized Similarity Measure and Feature Learning
Lin, L., Wang, G., Zuo, W., Feng, X., & Lei Zhang, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2567386 · Cited by 147
Matching People across Camera Views using Kernel Canonical Correlation Analysis
Lisanti, G., Masi, I., & Bimbo, A. D. (2014) · International Conference on Distributed Smart Cameras · doi:10.1145/2659021.2659036 · Cited by 122
Rastegari, M., Choi, J., Fakhraei, S., Daumé, H., & Davis, L. S. (2013) · Cited by 109
Matching NIR Face to VIS Face Using Transduction
Zhu, J., Zheng, W., Lai, J., & Li, S. Z. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2299977 · Cited by 95
Self-citationParallel field alignment for cross media retrieval
Mao, X., Lin, B., Cai, D., et al. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502087 · Cited by 84
Cross-Scenario Transfer Person Reidentification
Wang, X., Zheng, W., Li, X., & Zhang, J. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2450331 · Cited by 79
Self-citationParametric local multimodal hashing for cross-view similarity search
Zhai, D., Chang, H., Zhen, Y., Liu, X., Chen, X., & Gao, W. (2013) · International Joint Conference on Artificial Intelligence · Cited by 56
Deep Compositional Cross-modal Learning to Rank via Local-Global Alignment
Jiang, X., Wu, F. Q., Li, X., Zhao, Z., Lü, W., Tang, S., & Zhuang, Y. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806240 · Cited by 51
Local Feature Based Person Reidentification in Infrared Image Sequences
Jüngling, K., & Arens, M. (2010) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2010.75 · Cited by 36
Multi-shot Person Re-identification with Automatic Ambiguity Inference and Removal
Guo, C., Chen, S., Lai, J., et al. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.609 · Cited by 24
Self-citation
Cited by
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment
Wang, G., Zhang, T., Cheng, J., Liu, S., Yang, Y., & Hou, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00372 · Cited by 559
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-identification
Ye, M., Shen, J., J. Crandall, D., Shao, L., & Luo, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_14 · Cited by 523
Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification
Wang, Z., Wang, Z., Zheng, Y., Chuang, Y.-Y., & Satoh, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00071 · Cited by 493
Metadata
- Authors
- Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J.
- Venue
- 2017 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 5390-5399
- OpenAlex
- W2777534232
- Cited by
- 862
- References
- 56
- FWCI
- 7.85
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.