Is that you? Metric learning approaches for face identification
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Face identification is the problem of determining whether two face images depict the same person or not. This is difficult due to variations in scale, pose, lighting, background, expression, hairstyle, and glasses. In this paper we present two methods for learning robust distance measures: (a) a logistic discriminant approach which learns the metric from a set of labelled image pairs (LDML) and (b) a nearest neighbour approach which computes the probability for two images to belong to the same class (MkNN). We evaluate our approaches on the Labeled Faces in the Wild data set, a large and very challenging data set of faces from Yahoo! News. The evaluation protocol for this data set defines a restricted setting, where a fixed set of positive and negative image pairs is given, as well as an unrestricted one, where faces are labelled by their identity. We are the first to present results for the unrestricted setting, and show that our methods benefit from this richer training data, much more so than the current state-of-the-art method. Our results of 79.3% and 87.5% correct for the restricted and unrestricted setting respectively, significantly improve over the current state-of-the-art result of 78.5%. Confidence scores obtained for face identification can be used for many applications e.g. clustering or recognition from a single training example. We show that our learned metrics also improve performance for these tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Distance Metric Learning with Application to Clustering with Side-Information
Xing, E. P., Jordan, M. I., Russell, S., & Ng, A. Y. (2002) · Cited by 2,700
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · neural information processing systems · Cited by 2,132
Information-theoretic metric learning
Davis, J. V., Kulis, B., Jain, P., Sra, S., & Dhillon, I. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273523 · Cited by 2,006
Metric Learning by Collapsing Classes
Globerson, A., & Roweis, S. T. (2005) · Cited by 665
On the Goldstein-Levitin-Polyak gradient projection method
Bertsekas, D. P. (1976) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1976.1101194 · Cited by 583
Cited by
DeepReID: Deep Filter Pairing Neural Network for Person Re-identification
Li, W., Zhao, R., Xiao, T., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.27 · Cited by 2,611
Person re-identification by Local Maximal Occurrence representation and metric learning
Liao, S., Hu, Y., Zhu, X., & Li, S. Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298832 · Cited by 2,091
Deep Learning Face Representation from Predicting 10,000 Classes
Sun, Y., Wang, X., & Tang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.244 · Cited by 1,997
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Large scale metric learning from equivalence constraints
Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247939 · Cited by 1,606
Face recognition in unconstrained videos with matched background similarity
Wolf, L., Hassner, T., & Maoz, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995566 · Cited by 1,382
An improved deep learning architecture for person re-identification
Ahmed, E., Jones, M., & Marks, T. K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299016 · Cited by 1,248
Person Re-identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function
Cheng, D., Gong, Y., Zhou, S., Wang, J., & Zheng, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.149 · Cited by 1,247
Deep Learning for Content-Based Image Retrieval: A Comprehensive Study
Wan, J., Wang, D., Hoi, S. C. H., Wu, P., Zhu, J., Zhang, Y., & Li, J. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654948 · Cited by 811
Age and Gender Estimation of Unfiltered Faces
Eidinger, E., Enbar, R., & Hassner, T. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2359646 · Cited by 809
Frontal to profile face verification in the wild
Sengupta, S., Chen, J.-C., Castillo, C., Patel, V. M., Chellappa, R., & Jacobs, D. W. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477558 · Cited by 805
Gated Siamese Convolutional Neural Network Architecture for Human Re-identification
Varior, R. R., Haloi, M., & Wang, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_48 · Cited by 723
Discriminative Deep Metric Learning for Face Verification in the Wild
Hu, J., Lu, J., & Tan, Y.-P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.242 · Cited by 682
TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation
Guillaumin, M., Mensink, T., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459266 · Cited by 673
Self-citationKulis, B. (2013) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000019 · Cited by 672
Cosine Similarity Metric Learning for Face Verification
Nguyen, H. V., & Bai, L. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19309-5_55 · Cited by 655
Chen, D., Cao, X., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.389 · Cited by 615
PCCA: A new approach for distance learning from sparse pairwise constraints
Mignon, A., & Jurie, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247987 · Cited by 592
Locally Aligned Feature Transforms across Views
Li, W., & Wang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.461 · Cited by 574
A Siamese Long Short-Term Memory Architecture for Human Re-identification
Varior, R. R., Shuai, B., Lu, J., Xu, D., & Wang, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_9 · Cited by 524
A Survey on Metric Learning for Feature Vectors and Structured Data
Bellet, A., Habrard, A., & Sebban, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.6709 · Cited by 494
End-to-End Comparative Attention Networks for Person Re-Identification
Liu, H., Feng, J., Qi, M., Jiang, J., & Yan, S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2700762 · Cited by 482
Kulis, B. (2013) · now publishers, Inc. eBooks · doi:10.1561/9781601986979 · Cited by 482
Learning Locally-Adaptive Decision Functions for Person Verification
Li, Z., Chang, S., Liang, F., Huang, T. S., Cao, L., & Smith, J. R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.463 · Cited by 466
Labeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
Fisher Vector Faces in the Wild
Simonyan, K., Parkhi, O., Vedaldi, A., & Zisserman, A. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.8 · Cited by 445
Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.83 · Cited by 431
Self-citationFace recognition with learning-based descriptor
Cao, Z., Yin, Q., Tang, X., & Sun, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539992 · Cited by 430
Bayesian Face Revisited: A Joint Formulation
Chen, D., Cao, X., Wang, L., Wen, F., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_41 · Cited by 427
Learning hierarchical representations for face verification with convolutional deep belief networks
Huang, G. B., Lee, H., & Learned-Miller, E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247968 · Cited by 407
Efficient PSD Constrained Asymmetric Metric Learning for Person Re-Identification
Liao, S., & Li, S. Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.420 · Cited by 395
Joint Learning of Single-Image and Cross-Image Representations for Person Re-identification
Wang, F., Zuo, W., Lin, L., Zhang, D., & Zhang, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.144 · Cited by 389
Wolf, L., Hassner, T., & Taigman, Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.230 · Cited by 333
Hu, G., Yang, Y., Yi, D., Kittler, J., Christmas, W., Li, S. Z., & Hospedales, T. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.58 · Cited by 331
Multi-scale Deep Learning Architectures for Person Re-identification
Qian, X., Fu, Y., Jiang, Y.-G., Xiang, T., & Xue, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.577 · Cited by 319
Local Descriptors Encoded by Fisher Vectors for Person Re-identification
Ma, B., Su, Y., & Jurie, F. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33863-2_41 · Cited by 312
Hybrid Deep Learning for Face Verification
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.188 · Cited by 285
Discriminative Deep Metric Learning for Face and Kinship Verification
Lu, J., Hu, J., & Tan, Y.-P. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2717505 · Cited by 275
Embedding Deep Metric for Person Re-identification: A Study Against Large Variations
Shi, H., Yang, Y., Zhu, X., Liao, S., Lei, Z., Zheng, W., & Li, S. Z. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_44 · Cited by 257
Ma, B., Su, Y., & Jurie, F. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.002 · Cited by 254
Juefei-Xu, F., Luu, K., & Savvides, M. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2468173 · Cited by 74
Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers
Peng, K., Mathur, A., & Narayanan, A. (2021) · arXiv · doi:10.48550/arxiv.2108.02922 · Cited by 31
“D18 LFW [49] dataset X 220 105 X X D19 LFWA [59] dataset X 158 2 X X X X D20 LFW-a [86] dataset X 31 14 X X X D21 LFW3D [46] dataset X 24 3 X X X D22 LFW deep funneled [50] dataset X 18 4 X X X D23 LFW crop [73] dataset X 8 2 X X X D24 BLUFR protocol [57] dataset X 2 1 X D25*LFW87 [56] dataset X 7 1 D26 LFW+ [42] data…”
Background
Metadata
- Authors
- Guillaumin, M., Verbeek, J., & Schmid, C.
- Venue
- 2009 IEEE 12th International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 498-505
- OpenAlex
- W2109824782
- Cited by
- 757
- References
- 22
- FWCI
- 26.17
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.