PreprintCited by 1,906Face recognition and analysisFace and Expression RecognitionBiometric Identification and Security

Deep Learning Face Representation by Joint Identification-Verification

Open access
Sun, Yi, Wang, Xiaogang, Tang, Xiaoou·2014·arXiv

Abstract

The key challenge of face recognition is to develop effective feature representations for reducing intra-personal variations while enlarging inter-personal differences. In this paper, we show that it can be well solved with deep learning and using both face identification and verification signals as supervision. The Deep IDentification-verification features (DeepID2) are learned with carefully designed deep convolutional networks. The face identification task increases the inter-personal variations by drawing DeepID2 extracted from different identities apart, while the face verification task reduces the intra-personal variations by pulling DeepID2 extracted from the same identity together, both of which are essential to face recognition. The learned DeepID2 features can be well generalized to new identities unseen in the training data. On the challenging LFW dataset, 99.15% face verification accuracy is achieved. Compared with the best deep learning result on LFW, the error rate has been significantly reduced by 67%.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1406.4773

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 20

  1. [2][2] X. Cao, D. Wipf, F. Wen, G. Duan, and J. Sun. A practical transfer learning algorithm for face verification. In Proc. ICCV , 2013. -
  2. [3][3] D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun. Bayesian face revisited: A joint formulation. In Proc. ECCV , 2012. -
  3. [4][4] D. Chen, X. Cao, F. Wen, and J. Sun. Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Proc. CVPR , 2013. -
  4. [5][5] S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In Proc. CVPR , 2005. -
  5. [6][6] M. Guillaumin, J. Verbeek, and C. Schmid. Is that you? Metric learning approaches for face identification. In Proc. ICCV , 2009. -
  6. [7][7] R. Hadsell, S. Chopra, and Y. LeCun. Dimensionality reduction by learning an invariant mapping. In Proc. CVPR , 2006. -
  7. [8][8] J. Hu, J. Lu, and Y.-P. Tan. Discriminative deep metric learning for face verification in the wild. In Proc. CVPR , 2014. -
  8. [10][10] G. B. Huang, H. Lee, and E. Learned-Miller. Learning hierarchical representations for face verification with convolutional deep belief networks. In Proc. CVPR , 2012. -
  9. [13][13] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE , 1998. -
  10. [14][14] C. Lu and X. Tang. Surpassing human-level face verification performance on LFW with GaussianFace. Technical report, arXiv:1404.3840, 2014. - · arXiv
  11. [15][15] A. Mignon and F. Jurie. PCCA: A new approach for distance learning from sparse pairwise constraints. In Proc. CVPR , 2012. -
  12. [18][18] V. Nair and G. E. Hinton. Rectified linear units improve restricted Boltzmann machines. In Proc. ICML , 2010. -
  13. [19][19] P. Sermanet and Y. Lecun. Traffic sign recognition with multi-scale convolutional networks. In Proc. IJCNN , 2011. -
  14. [20][20] Y. Sun, X. Wang, and X. Tang. Hybrid deep learning for face verification. In Proc. ICCV , 2013. -
  15. [21][21] Y. Sun, X. Wang, and X. Tang. Deep learning face representation from predicting 10,000 classes. In Proc. CVPR , 2014. -
  16. [22][22] Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. DeepFace: Closing the gap to human-level performance in face verification. In Proc. CVPR , 2014. -
  17. [23][23] X. Wang and X. Tang. Unified subspace analysis for face recognition. In Proc. ICCV , 2003. -
  18. [25][25] X. Xiong and F. De la Torre Frade. Supervised descent method and its applications to face alignment. In Proc. CVPR , 2013. -
  19. [26][26] T. Zhang. Adaptive forward-backward greedy algorithm for learning sparse representations. IEEE Trans. Inf. Theor. , 57:4689-4708, 2011. -
  20. [27][27] Z. Zhu, P. Luo, X. Wang, and X. Tang. Deep learning identity-preserving face space. In Proc. ICCV , 2013.

Cited by

Sorted by citations

Authors
Sun, Y., Wang, X., & Tang, X.
Affiliations
Chinese University of Hong Kong (HK)
Venue
arXiv
Publisher
arXiv
Published
2014
Volume
27
Pages
1988-1996
ISSN
2331-8422 (ISSN-L)
OpenAlex
W2144172034
Cited by
1,906
References
2
Citations by year
2025: 27 · 2024: 69 · 2023: 114 · 2022: 132 · 2021: 221 · 2020: 288 · 2019: 322 · 2018: 258 · 2017: 249 · 2016: 134 · 2015: 84 · 2014: 7 · 2012: 1
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • neural information processing systems
Funders
Fundação para a Ciência e a Tecnologia (UIDB/00319, 00319, UIDB/00319/2020)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
  • Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
Keywords
face recognition, face identification, face verification, deep convolutional neural networks, feature representation learning, within-person variability, LFW dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review