The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition
Open accessAbstract
Heterogeneous face recognition (HFR) aims at matching facial images acquired from different sensing modalities with mission-critical applications in forensics, security and commercial sectors. However, HFR presents more challenging issues than traditional face recognition because of the large intra-class variation among heterogeneous face images and the limited availability of training samples of cross-modality face image pairs. This paper proposes the novel Wasserstein convolutional neural network (WCNN) approach for learning invariant features between near-infrared (NIR) and visual (VIS) face images (i.e., NIR-VIS face recognition). The low-level layers of the WCNN are trained with widely available face images in the VIS spectrum, and the high-level layer is divided into three parts: the NIR layer, the VIS layer and the NIR-VIS shared layer. The first two layers aim at learning modality-specific features, and the NIR-VIS shared layer is designed to learn a modality-invariant feature subspace. The Wasserstein distance is introduced into the NIR-VIS shared layer to measure the dissimilarity between heterogeneous feature distributions. W-CNN learning is performed to minimize the Wasserstein distance between the NIR distribution and the VIS distribution for invariant deep feature representations of heterogeneous face images. To avoid the over-fitting problem on small-scale heterogeneous face data, a correlation prior is introduced on the fully-connected WCNN layers to reduce the size of the parameter space. This prior is implemented by a low-rank constraint in an end-to-end network. The joint formulation leads to an alternating minimization for deep feature representation at the training stage and an efficient computation for heterogeneous data at the testing stage. Extensive experiments using three challenging NIR-VIS face recognition databases demonstrate the superiority of the WCNN method over state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
(2010) · Cited by 14,134
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
(2017) · International Conference on Machine Learning · Cited by 6,382
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_6 · Cited by 2,122
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
A Light CNN for Deep Face Representation With Noisy Labels
Wu, X., He, R., Sun, Z., & Tan, T. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2833032 · Cited by 1,186
Self-citationFace Photo-Sketch Synthesis and Recognition
Wang, X., & Tang, X. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.222 · Cited by 900
Huang, R., Zhang, S., Li, T., & He, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.267 · Cited by 687
Self-citationBEGAN: Boundary Equilibrium Generative Adversarial Networks
Berthelot, D., Schumm, T., & Metz, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10717 · Cited by 654
Multi-View Discriminant Analysis
Kan, M., Shan, S., Zhang, H., Lao, S., & Chen, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2435740 · Cited by 581
Wang, S., Zhang, L., Liang, Y., & Pan, Q. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247930 · Cited by 532
Labeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
Bayesian Face Revisited: A Joint Formulation
Chen, D., Cao, X., Wang, L., Wen, F., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_41 · Cited by 427
Matching Forensic Sketches to Mug Shot Photos
Klare, B., Li, Z., & Jain, A. K. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.180 · Cited by 380
Heterogeneous Face Recognition Using Kernel Prototype Similarities
Klare, B. F., & Jain, A. K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.229 · Cited by 362
Learning Discriminant Face Descriptor
Lei, Z., Pietikainen, M., & Li, S. Z. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.112 · Cited by 346
Face sketch synthesis and recognition
Tang, X., & Wang, X. (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238414 · Cited by 281
Learning Coupled Feature Spaces for Cross-Modal Matching
Wang, K., He, R., Wang, W., Wang, L., & Tan, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.261 · Cited by 235
Self-citationInter-modality Face Recognition
Lin, D., & Tang, X. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_2 · Cited by 204
Heterogeneous Face Recognition: Matching NIR to Visible Light Images
Klare, B. F., & Jain, A. K. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.374 · Cited by 183
Huang, D.-A., & Wang, Y.-C. F. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.310 · Cited by 175
Coupled Spectral Regression for matching heterogeneous faces
Lei, Z., & Li, S. Z. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206860 · Cited by 162
Learning Invariant Deep Representation for NIR-VIS Face Recognition
He, R., Wu, X., Sun, Z., & Tan, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10786 · Cited by 162
Self-citationFace photo recognition using sketch
Tang, X., & Wang, X. (2003) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2002.1038008 · Cited by 160
Juefei-Xu, F., Pal, D. K., & Savvides, M. (2015) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301308 · Cited by 150
Lezama, J., Qiu, Q., & Sapiro, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.720 · Cited by 149
Learning mappings for face synthesis from near infrared to visual light images
Chen, J., Yi, D., Yang, J., Zhao, G., Li, S. Z., & Pietikäinen, M. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206832 · Cited by 146
Heterogeneous Face Recognition from Local Structures of Normalized Appearance
Liao, S., Yi, D., Lei, Z., Qin, R., & Li, S. Z. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01793-3_22 · Cited by 140
A survey on heterogeneous face recognition: Sketch, infra-red, 3D and low-resolution
Ouyang, S., Hospedales, T. M., Song, Y.-Z., Li, X., Loy, C. C., & Wang, X. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.09.001 · Cited by 137
Shared representation learning for heterogenous face recognition
Yi, D., Lei, Z., & Li, S. Z. (2015) · IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163093 · Cited by 135
Transferring deep representation for NIR-VIS heterogeneous face recognition
Liu, X., Song, L., Wu, X., & Tan, T. (2016) · International Conference on Biometrics · doi:10.1109/icb.2016.7550064 · Cited by 135
Self-citationMultidimensional Scaling for Matching Low-Resolution Face Images
Biswas, S., Bowyer, K. W., & Flynn, P. J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.278 · Cited by 124
Heterogeneous Face Recognition with CNNs
Saxena, S., & Verbeek, J. J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49409-8_40 · Cited by 117
VIPLFaceNet: an open source deep face recognition SDK
Liu, X., Kan, M., Wu, W., Shan, S., & Chen, X. (2017) · Frontiers of Computer Science · doi:10.1007/s11704-016-6076-3 · Cited by 111
Coupled Discriminative Feature Learning for Heterogeneous Face Recognition
Jin, Y., Lu, J., & Ruan, Q. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2390414 · Cited by 103
Heterogeneous Face Recognition: A Common Encoding Feature Discriminant Approach
Gong, D., Li, Z., Huang, W., Li, X., & Tao, D. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2651380 · Cited by 102
Coupled Discriminant Analysis for Heterogeneous Face Recognition
Lei, Z., Liao, S., Jain, A. K., & Li, S. Z. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2210041 · Cited by 98
Matching NIR Face to VIS Face Using Transduction
Zhu, J., Zheng, W., Lai, J., & Li, S. Z. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2299977 · Cited by 95
Face shape recovery from a single image using CCA mapping between tensor spaces
Lei, Z., Bai, Q., He, R., & Li, S. Z. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587341 · Cited by 71
Self-citationCross-Modality Feature Learning Through Generic Hierarchical Hyperlingual-Words
Shao, M., & Fu, Y. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2517014 · Cited by 60
Dhamecha, T. I., Sharma, P. K., Singh, R., et al. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.314 · Cited by 45
Evaluation of face recognition system in heterogeneous environments (visible vs NIR)
Goswami, D., Chan, C. H., Windridge, D., & Kittler, J. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130515 · Cited by 41
Mutual Component Analysis for Heterogeneous Face Recognition
Li, Z., Gong, D., Li, Q., et al. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2807705 · Cited by 39
Face Recognition by Discriminant Analysis with Gabor Tensor Representation
Lei, Z., Chu, R., He, R., Liao, S., & Li, S. Z. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74549-5_10 · Cited by 26
Self-citation
Cited by
A Survey of Deep Learning-Based Object Detection
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., & Qu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2939201 · Cited by 1,323
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
Unsupervised Person Re-Identification by Soft Multilabel Learning
Yu, H.-X., Zheng, W.-S., Wu, A., Guo, X., Gong, S., & Lai, J.-H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00225 · Cited by 421
Deep learning in multi-object detection and tracking: state of the art
Pal, S. K., Pramanik, A., Maiti, J., & Mitra, P. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02293-7 · Cited by 298
A review of video surveillance systems
Elharrouss, O., Almaadeed, N., & Al-Maadeed, S. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103116 · Cited by 283
Metadata
- Authors
- He, R., Wu, X., Sun, Z., & Tan, T.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-07-01
- Volume
- 41
- Issue
- 7
- Pages
- 1761-1773
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2963809521
- Cited by
- 317
- References
- 46
- FWCI
- 19.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.