FaceNet: A Unified Embedding for Face Recognition and Clustering
Open accessAbstract
Despite significant recent advances in the field of face recognition, implementing face verification and recognition efficiently at scale presents serious challenges to current approaches. In this paper we present a system, called FaceNet, that directly learns a mapping from face images to a compact Euclidean space where distances directly correspond to a measure of face similarity. Once this space has been produced, tasks such as face recognition, verification and clustering can be easily implemented using standard techniques with FaceNet embeddings as feature vectors. Our method uses a deep convolutional network trained to directly optimize the embedding itself, rather than an intermediate bottleneck layer as in previous deep learning approaches. To train, we use triplets of roughly aligned matching / non-matching face patches generated using a novel online triplet mining method. The benefit of our approach is much greater representational efficiency: we achieve state-of-the-art face recognition performance using only 128-bytes per face. On the widely used Labeled Faces in the Wild (LFW) dataset, our system achieves a new record accuracy of 99.63%. On YouTube Faces DB it achieves 95.12%. Our system cuts the error rate in comparison to the best published result by 30% on both datasets. We also introduce the concept of harmonic embeddings, and a harmonic triplet loss, which describe different versions of face embeddings (produced by different networks) that are compatible to each other and allow for direct comparison between each other.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 29 · Cited by 15,392
Research works printed but not linked: 20
- [1][1] Y. Bengio, J. Louradour, R. Collobert, and J. Weston. Curriculum learning. In Proc. of ICML , New York, NY, USA, 2009. 2 -
- [2][2] D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun. Bayesian face revisited: A joint formulation. In Proc. ECCV , 2012. 2 -
- [3][3] D. Chen, S. Ren, Y. Wei, X. Cao, and J. Sun. Joint cascade face detection and alignment. In Proc. ECCV , 2014. 7 -
- [4][4] J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, M. Mao, M. Ranzato, A. Senior, P. Tucker, K. Yang, Q. V. Le, and A. Y. Ng. Large scale distributed deep networks. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, and K. Weinberger, editors, NIPS , pages 1232-1240. 2012. 10 -
- [6][6] I. J. Goodfellow, D. Warde-farley, M. Mirza, A. Courville, and Y. Bengio. Maxout networks. In In ICML , 2013. 4 -
- [8][8] Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Backpropagation 9. applied to handwritten zip code recognition. Neural Computation , 1(4):541-551, Dec. 1989. 2, 4 -
- [9][9] M. Lin, Q. Chen, and S. Yan. Network in network. CoRR , abs/1312.4400, 2013. 2, 4, 6 - · arXiv
- [10][10] C. Lu and X. Tang. Surpassing human-level face verification performance on LFW with gaussianface. CoRR , abs/1404.3840, 2014. 1 - · arXiv
- [12][12] M. Schultz and T. Joachims. Learning a distance metric from relative comparisons. In S. Thrun, L. Saul, and B. Schölkopf, editors, NIPS , pages 41-48. MIT Press, 2004. 2 -
- [13][13] T. Sim, S. Baker, and M. Bsat. The CMU pose, illumination, and expression (PIE) database. In In Proc. FG , 2002. 2 -
- [14][14] Y. Sun, X. Wang, and X. Tang. Deep learning face representation by joint identification-verification. CoRR , abs/1406.4773, 2014. 1, 2, 3 - · arXiv
- [15][15] Y. Sun, X. Wang, and X. Tang. Deeply learned face representations are sparse, selective, and robust. CoRR , abs/1412.1265, 2014. 1, 2, 5, 8 - · arXiv
- [16][16] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. CoRR , abs/1409.4842, 2014. 2, 3, 4, 5, 6, 10 - · arXiv
- [17][17] Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In IEEE Conf. on CVPR , 2014. 1, 2, 5, 7, 8, 9 -
- [18][18] J. Wang, Y. Song, T. Leung, C. Rosenberg, J. Wang, J. Philbin, B. Chen, and Y. Wu. Learning fine-grained image similarity with deep ranking. CoRR , abs/1404.4661, 2014. 2 - · arXiv
- [19][19] K. Q. Weinberger, J. Blitzer, and L. K. Saul. Distance metric learning for large margin nearest neighbor classification. In NIPS . MIT Press, 2006. 2, 3 -
- [20][20] D. R. Wilson and T. R. Martinez. The general inefficiency of batch training for gradient descent learning. Neural Networks , 16(10):1429-1451, 2003. 4 -
- [21][21] L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In IEEE Conf. on CVPR , 2011. 5 -
- [22][22] M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. CoRR , abs/1311.2901, 2013. 2, 3, 4, 6 - · arXiv
- [23][23] Z. Zhu, P. Luo, X. Wang, and X. Tang. Recover canonicalview faces in the wild with deep neural networks. CoRR , abs/1404.3543, 2014. 2 · arXiv
- Authors
- Schroff, F., Kalenichenko, D., & Philbin, J.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 815-823
- ISSN
- 1063-6919 (ISSN-L)
- arXiv
- 1503.03832
- OpenAlex
- W2096733369
- Cited by
- 15,392
- References
- 29
- Citations by year
- 2026: 870 · 2025: 1558 · 2024: 1593 · 2023: 1826 · 2022: 1878 · 2021: 2130 · 2020: 1933 · 2019: 1595 · 2018: 1073 · 2017: 599 · 2016: 283 · 2015: 50 · 2014: 1 · 2012: 2
- FWCI
- 271.65
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (publishedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- FaceNet, face recognition, face verification, face clustering, embedding space, triplet loss, deep convolutional neural networks, face similarity, Labeled Faces in the Wild
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
