Deep Learning Face Representation by Joint Identification-Verification
Open accessAbstract
The key challenge of face recognition is to develop effective feature representations for reducing intra-personal variations while enlarging inter-personal differences. In this paper, we show that it can be well solved with deep learning and using both face identification and verification signals as supervision. The Deep IDentification-verification features (DeepID2) are learned with carefully designed deep convolutional networks. The face identification task increases the inter-personal variations by drawing DeepID2 extracted from different identities apart, while the face verification task reduces the intra-personal variations by pulling DeepID2 extracted from the same identity together, both of which are essential to face recognition. The learned DeepID2 features can be well generalized to new identities unseen in the training data. On the challenging LFW dataset, 99.15% face verification accuracy is achieved. Compared with the best deep learning result on LFW, the error rate has been significantly reduced by 67%.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Deep learning from temporal coherence in video
Mobahi, H., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553469 · Cited by 328 · see citing works
Flagged first, then by citations
Research works printed but not linked: 20
- [2][2] X. Cao, D. Wipf, F. Wen, G. Duan, and J. Sun. A practical transfer learning algorithm for face verification. In Proc. ICCV , 2013. -
- [3][3] D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun. Bayesian face revisited: A joint formulation. In Proc. ECCV , 2012. -
- [4][4] D. Chen, X. Cao, F. Wen, and J. Sun. Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Proc. CVPR , 2013. -
- [5][5] S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In Proc. CVPR , 2005. -
- [6][6] M. Guillaumin, J. Verbeek, and C. Schmid. Is that you? Metric learning approaches for face identification. In Proc. ICCV , 2009. -
- [7][7] R. Hadsell, S. Chopra, and Y. LeCun. Dimensionality reduction by learning an invariant mapping. In Proc. CVPR , 2006. -
- [8][8] J. Hu, J. Lu, and Y.-P. Tan. Discriminative deep metric learning for face verification in the wild. In Proc. CVPR , 2014. -
- [10][10] G. B. Huang, H. Lee, and E. Learned-Miller. Learning hierarchical representations for face verification with convolutional deep belief networks. In Proc. CVPR , 2012. -
- [13][13] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE , 1998. -
- [14][14] C. Lu and X. Tang. Surpassing human-level face verification performance on LFW with GaussianFace. Technical report, arXiv:1404.3840, 2014. - · arXiv
- [15][15] A. Mignon and F. Jurie. PCCA: A new approach for distance learning from sparse pairwise constraints. In Proc. CVPR , 2012. -
- [18][18] V. Nair and G. E. Hinton. Rectified linear units improve restricted Boltzmann machines. In Proc. ICML , 2010. -
- [19][19] P. Sermanet and Y. Lecun. Traffic sign recognition with multi-scale convolutional networks. In Proc. IJCNN , 2011. -
- [20][20] Y. Sun, X. Wang, and X. Tang. Hybrid deep learning for face verification. In Proc. ICCV , 2013. -
- [21][21] Y. Sun, X. Wang, and X. Tang. Deep learning face representation from predicting 10,000 classes. In Proc. CVPR , 2014. -
- [22][22] Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. DeepFace: Closing the gap to human-level performance in face verification. In Proc. CVPR , 2014. -
- [23][23] X. Wang and X. Tang. Unified subspace analysis for face recognition. In Proc. ICCV , 2003. -
- [25][25] X. Xiong and F. De la Torre Frade. Supervised descent method and its applications to face alignment. In Proc. CVPR , 2013. -
- [26][26] T. Zhang. Adaptive forward-backward greedy algorithm for learning sparse representations. IEEE Trans. Inf. Theor. , 57:4689-4708, 2011. -
- [27][27] Z. Zhu, P. Luo, X. Wang, and X. Tang. Deep learning identity-preserving face space. In Proc. ICCV , 2013.
Cited by
Sorted by citations
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · see citing works
“Convolutional neural networks (CNNs) [19, 18] have demonstrated recognition accuracy better than or comparable to humans in several visual recognition tasks, including recognizing traffic signs [3], faces [34, 32], and handwritten digits [3, 36].”
BackgroundFaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · see citing works
“the one using pairs of positives and negatives, as used in [14] Eq.”
BackgroundMethodInfluentialImage Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105 · see citing works
Self-citationDeep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747 · see citing works
Self-citationArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781 · see citing works
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273 · see citing works
“It was first used in SiameseNet [67] and later was deployed in DeepID2 [68], DeepID2+ [69], and DeepID3 [70].”
BackgroundMethodInfluentialParkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · see citing works
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077 · see citing works
CosFace: Large Margin Cosine Loss for Deep Face Recognition
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00552 · Cited by 3,034 · see citing works
Recent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047 · see citing works
Effective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613 · see citing works
Robust Face Recognition via Multimodal Deep Face Representation
Ding, C., & Tao, D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477042 · Cited by 449 · see citing works
Feature Transfer Learning for Face Recognition With Under-Represented Data
Yin, X., Yu, X., Sohn, K., Liu, X., & Chandraker, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00585 · Cited by 346 · see citing works
Racial faces in the wild: Reducing racial bias by information maximization adaptation network
Wang, M., Deng, W., Hu, J., Tao, X., & Huang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00078 · Cited by 353 · see citing works
CCL: Cross-modal Correlation Learning With Multigrained Fusion by Hierarchical Network
Peng, Y., Qi, J., Huang, X., & Yuan, Y. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2742704 · Cited by 228 · see citing works
Striking the Right Balance With Uncertainty
Khan, S., Hayat, M., Zamir, S. W., Shen, J., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00019 · Cited by 180 · see citing works
On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques
Li, P., Prieto, L., Mery, D., & Flynn, P. J. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2890812 · Cited by 171 · see citing works
Edge Video Analytics for Public Safety: A Review
Zhang, Q., Sun, H., Wu, X., & Zhong, H. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2925910 · Cited by 156 · see citing works
Facial Expression Recognition with Identity and Emotion Joint Learning
Li, M., Xu, H., Huang, X., Song, Z., Liu, X., & Li, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2880201 · Cited by 128 · see citing works
Adaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems · doi:10.1145/3211332.3211336 · Cited by 90 · see citing works
Audio-Visual Deep Neural Network for Robust Person Verification
Qian, Y., Chen, Z., & Wang, S. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3057230 · Cited by 63 · see citing works
Masoudnia, S., Mersa, O., Araabi, B. N., Vahabie, A.-H., Sadeghi, M. A., & Ahmadabadi, M. N. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.040 · Cited by 57 · see citing works
Kim, J., Kang, J.-K., & Kim, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3099075 · Cited by 50 · see citing works
- Authors
- Sun, Y., Wang, X., & Tang, X.
- Affiliations
- Chinese University of Hong Kong (HK)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- Volume
- 27
- Pages
- 1988-1996
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1406.4773
- OpenAlex
- W2144172034
- Cited by
- 1,906
- References
- 2
- Citations by year
- 2025: 27 · 2024: 69 · 2023: 114 · 2022: 132 · 2021: 221 · 2020: 288 · 2019: 322 · 2018: 258 · 2017: 249 · 2016: 134 · 2015: 84 · 2014: 7 · 2012: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Funders
- Fundação para a Ciência e a Tecnologia (UIDB/00319, 00319, UIDB/00319/2020)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- face recognition, face identification, face verification, deep convolutional neural networks, feature representation learning, within-person variability, LFW dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review