The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Discriminative Deep Metric Learning for Face and Kinship Verification
Abstract
This paper presents a new discriminative deep metric learning (DDML) method for face and kinship verification in wild conditions. While metric learning has achieved reasonably good performance in face and kinship verification, most existing metric learning methods aim to learn a single Mahalanobis distance metric to maximize the inter-class variations and minimize the intra-class variations, which cannot capture the nonlinear manifold where face images usually lie on. To address this, we propose a DDML method to train a deep neural network to learn a set of hierarchical nonlinear transformations to project face pairs into the same latent feature space, under which the distance of each positive pair is reduced and that of each negative pair is enlarged. To better use the commonality of multiple feature descriptors to make all the features more robust for face and kinship verification, we develop a discriminative deep multi-metric learning method to jointly learn multiple neural networks, under which the correlation of different features of each sample is maximized, and the distance of each positive pair is reduced and that of each negative pair is enlarged. Extensive experimental results show that our proposed methods achieve the acceptable results in both face and kinship verification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · Cited by 14,134
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,584
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · neural information processing systems · Cited by 2,132
Information-theoretic metric learning
Davis, J. V., Kulis, B., Jain, P., Sra, S., & Dhillon, I. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273523 · Cited by 2,006
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Large scale metric learning from equivalence constraints
Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247939 · Cited by 1,606
Face recognition in unconstrained videos with matched background similarity
Wolf, L., Hassner, T., & Maoz, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995566 · Cited by 1,382
Le, Q. V., Zou, W. Y., Yeung, S. Y., & Ng, A. Y. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995496 · Cited by 960
Deeply learned face representations are sparse, selective, and robust
Sun, Y., Wang, X., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298907 · Cited by 939
Is that you? Metric learning approaches for face identification
Guillaumin, M., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459197 · Cited by 757
Discriminative Deep Metric Learning for Face Verification in the Wild
Hu, J., Lu, J., & Tan, Y.-P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.242 · Cited by 682
Self-citationCosine Similarity Metric Learning for Face Verification
Nguyen, H. V., & Bai, L. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19309-5_55 · Cited by 655
Convolutional Learning of Spatio-temporal Features
Taylor, G. W., Fergus, R., LeCun, Y., & Bregler, C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15567-3_11 · Cited by 629
Chen, D., Cao, X., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.389 · Cited by 615
PCCA: A new approach for distance learning from sparse pairwise constraints
Mignon, A., & Jurie, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247987 · Cited by 592
Fisher Vector Faces in the Wild
Simonyan, K., Parkhi, O., Vedaldi, A., & Zisserman, A. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.8 · Cited by 445
Descriptor Based Methods in the Wild
Wolf, L., Hassner, T., & Taigman, Y. (2008) · HAL · Cited by 444
Bayesian Face Revisited: A Joint Formulation
Chen, D., Cao, X., Wang, L., Wen, F., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_41 · Cited by 427
Neighborhood Repulsed Metric Learning for Kinship Verification
Lu, J., Zhou, X., Tan, Y.-P., Shang, Y., & Zhou, J. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.134 · Cited by 427
Self-citationLearning hierarchical representations for face verification with convolutional deep belief networks
Huang, G. B., Lee, H., & Learned-Miller, E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247968 · Cited by 407
Learning Discriminant Face Descriptor
Lei, Z., Pietikainen, M., & Li, S. Z. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.112 · Cited by 346
Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample per Person
Lu, J., Tan, Y.-P., & Wang, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.70 · Cited by 334
Self-citationDeep Learning Identity-Preserving Face Space
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.21 · Cited by 312
Recognition of blurred faces using Local Phase Quantization
Ahonen, T., Rahtu, E., Ojansivu, V., & Heikkila, J. (2008) · 2008 19th International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761847 · Cited by 301
Towards computational models of kinship verification
Fang, R., Tang, K. D., Snavely, N., & Chen, T. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5652590 · Cited by 293
Hybrid Deep Learning for Face Verification
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.188 · Cited by 285
Similarity Scores Based on Background Samples
Wolf, L., Hassner, T., & Taigman, Y. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12304-7_9 · Cited by 279
Understanding Kin Relationships in a Photo
Xia, S., Shao, M., Luo, J., & Fu, Y. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2187436 · Cited by 247
Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses
Kan, M., Shan, S., Chang, H., & Chen, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.243 · Cited by 243
Correlational spectral clustering
Blaschko, M. B., & Lampert, C. H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587353 · Cited by 236
Similarity Metric Learning for Face Recognition
Cao, Q., Ying, Y., & Li, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.299 · Cited by 233
Probabilistic Models for Inference about Identity
Li, P., Fu, Y., Mohammed, U., Elder, J. H., & Prince, S. J. D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.104 · Cited by 215
Towards Pose Robust Face Recognition
Yi, D., Lei, Z., & Li, S. Z. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.454 · Cited by 202
Probabilistic Elastic Matching for Pose Variant Face Verification
Li, H., Hua, G., Lin, Z., Brandt, J., & Yang, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.449 · Cited by 199
Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild
Cui, Z., Li, W., Xu, D., Shan, S., & Chen, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.456 · Cited by 193
Fast High Dimensional Vector Multiplication Face Recognition
Barkan, O., Weill, J., Wolf, L., & Aronowitz, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.246 · Cited by 172
Kinship verification from facial images under uncontrolled conditions
Zhou, X., Hu, J., Lu, J., Shang, Y., & Guan, Y. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2071911 · Cited by 146
Self-citationMultiple feature fusion by subspace learning
Fu, Y., Cao, L., Guo, G., & Huang, T. S. (2008) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1386352.1386373 · Cited by 143
Tri-Subject Kinship Verification: Understanding the Core of A Family
Qin, X., Tan, X., & Chen, S. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2461462 · Cited by 139
Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments
Zhou, X., Lu, J., Hu, J., & Shang, Y. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396297 · Cited by 121
Self-citationKinship Measurement on Salient Facial Features
Guo, G., & Wang, X. (2012) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2012.2187468 · Cited by 114
Hu, J., Lu, J., Tan, Y., & Zhou, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2612827 · Cited by 91
Self-citationSelf-similarity representation of Weber faces for kinship classification
Kohli, N., Singh, R., & Vatsa, M. (2012) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2012.6374584 · Cited by 81
Deep Metric Learning for Visual Tracking
Hu, J., Lu, J., & Tan, Y. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2477936 · Cited by 80
Self-citationDeep nonlinear metric learning with independent subspace analysis for face verification
Cai, X., Wang, C., Xiao, B., Chen, X., & Zhou, J. J. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396303 · Cited by 78
Neighborhood repulsed metric learning for kinship verification
Lu, J., Hu, J., Zhou, X., Shang, Y., Tan, Y., & Wang, G. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247978 · Cited by 74
Self-citationRandom Faces Guided Sparse Many-to-One Encoder for Pose-Invariant Face Recognition
Zhang, Y., Shao, M., Wong, E. K., & Fu, Y. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.300 · Cited by 67
The SVM-Minus Similarity Score for Video Face Recognition
Wolf, L., & Levy, N. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.452 · Cited by 65
Volume structured ordinal features with background similarity measure for video face recognition
Méndez-Vázquez, H., Martínez-Díaz, Y., & Chai, Z. (2013) · International Conference on Biometrics · doi:10.1109/icb.2013.6612990 · Cited by 52
Zhang, Z., Chen, Y., & Saligrama, V. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.446 · Cited by 47
Can faces verify blood-relations?
Somanath, G., & Kambhamettu, C. (2012) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2012.6374564 · Cited by 44
Cited by
Chen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Deep Metric Learning: A Survey
KAYA, M., & BİLGE, H. Ş. (2019) · Symmetry · doi:10.3390/sym11091066 · Cited by 703
Metadata
- Authors
- Lu, J., Hu, J., & Tan, Y.-P.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-09
- Volume
- 26
- Issue
- 9
- Pages
- 4269-4282
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2679426462
- Cited by
- 275
- References
- 63
- FWCI
- 18.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.