The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Face recognition in unconstrained videos with matched background similarity
Abstract
Recognizing faces in unconstrained videos is a task of mounting importance. While obviously related to face recognition in still images, it has its own unique characteristics and algorithmic requirements. Over the years several methods have been suggested for this problem, and a few benchmark data sets have been assembled to facilitate its study. However, there is a sizable gap between the actual application needs and the current state of the art. In this paper we make the following contributions. (a) We present a comprehensive database of labeled videos of faces in challenging, uncontrolled conditions (i.e., `in the wild'), the `YouTube Faces' database, along with benchmark, pair-matching tests1. (b) We employ our benchmark to survey and compare the performance of a large variety of existing video face recognition techniques. Finally, (c) we describe a novel set-to-set similarity measure, the Matched Background Similarity (MBGS). This similarity is shown to considerably improve performance on the benchmark tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Robust Face Recognition via Sparse Representation
Wright, J., Yang, A. Y., Ganesh, A., Sastry, S. S., & Ma, Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.79 · Cited by 9,388
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,584
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
The FERET evaluation methodology for face-recognition algorithms
Phillips, P. J., Moon, H., Rizvi, S. A., & Rauss, P. J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879790 · Cited by 3,692
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100 · cited 1×
“In order to maintain a reasonable runtime, in our experiments we employ the LLC method [18], in which the sparse coefficients are computed based on the k-nearest dictionary vectors to each set element.”
MethodThe Geometry of Algorithms with Orthogonality Constraints
Edelman, A., Arias, T. A., & Smith, S. T. (1998) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479895290954 · Cited by 2,685
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.268 · Cited by 2,438
The CMU pose, illumination, and expression database
Sim, T., Baker, S., & Bsat, M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251154 · Cited by 1,783
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
The pyramid match kernel: discriminative classification with sets of image features
Grauman, K., & Darrell, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.239 · Cited by 1,481
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Discriminant analysis for recognition of human face images
Etemad, K., & Chellappa, R. (1997) · Journal of the Optical Society of America A · doi:10.1364/josaa.14.001724 · Cited by 903
Is that you? Metric learning approaches for face identification
Guillaumin, M., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459197 · Cited by 757
Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video
Everingham, M. R., Sivic, J., & Zisserman, A. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.92 · Cited by 552
Face recognition using temporal image sequence
Yamaguchi, O., Fukui, E., & Maeda, K. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670968 · Cited by 462
Video-based face recognition using probabilistic appearance manifolds
Lee, K.-C., Ho, J., Yang, M.-H., & Kriegman, D. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211369 · Cited by 454
Descriptor Based Methods in the Wild
Wolf, L., Hassner, T., & Taigman, Y. (2008) · HAL · Cited by 444
Self-citationStatistics on Special Manifolds
Chikuse, Y. (2003) · Lecture Notes in Statistics · doi:10.1007/978-0-387-21540-2 · Cited by 411
Manifold-Manifold Distance with application to face recognition based on image set
Wang, R., Shan, S., Chen, X., & Gao, W. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587719 · Cited by 387
Description of Interest Regions with Center-Symmetric Local Binary Patterns
Heikkilä, M., Pietikäinen, M., & Schmid, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11949619_6 · Cited by 348
Face Recognition from Long-Term Observations
Shakhnarovich, G., Fisher, J. W., & Darrell, T. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_56 · Cited by 299
Similarity Scores Based on Background Samples
Wolf, L., Hassner, T., & Taigman, Y. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12304-7_9 · Cited by 279
Self-citationA unified learning framework for real time face detection and classification
Shakhnarovich, G., Viola, P. A., & Moghaddam, B. (2003) · Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition · doi:10.1109/afgr.2002.1004124 · Cited by 241
Face recognition by elastic bunch graph matching
Wiskott, L., Fellous, J.-M., Kruger, N., & von der Malsburg, C. (1997) · Proceedings of International Conference on Image Processing · doi:10.1109/icip.1997.647401 · Cited by 232
Visual tracking and recognition using probabilistic appearance manifolds
Lee, K.-C., Ho, J., Yang, M.-H., & Kriegman, D. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.02.002 · Cited by 228
“Who are you?” - Learning person specific classifiers from video
Sivic, J., Everingham, M., & Zisserman, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206513 · Cited by 223
A video database of moving faces and people
O'Toole, A. J., Ha, J., Snow, S. L., Hurst, D. R., Pappas, M. R., Ayyad, J. H., & Abdi, H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.90 · Cited by 212
Attribute-based people search in surveillance environments
Vaquero, D. A., Feris, R. S., Tran, D., Brown, L., Hampapur, A., & Turk, M. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403131 · Cited by 189
Taking the bite out of automated naming of characters in TV video
Everingham, M., Sivic, J., & Zisserman, A. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.04.018 · Cited by 176
Multiple One-Shots for Utilizing Class Label Information
Taigman, Y., Wolf, L., & Hassner, T. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.77 · Cited by 173
Self-citationAutotagging Facebook: Social network context improves photo annotation
Stone, Z., Zickler, T., & Darrell, T. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562956 · Cited by 171
Preliminary Face Recognition Grand Challenge Results
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., & Worek, W. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.87 · Cited by 167
O’Toole, A. J., Phillips, P. J., Weimer, S., Roark, D. A., Ayyad, J., Barwick, R., & Dunlop, J. P. (2010) · Vision Research · doi:10.1016/j.visres.2010.09.035 · Cited by 135
Boosted multi-task learning for face verification with applications to web image and video search
Wang, X., Zhang, C., & Zhang, Z. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206736 · Cited by 112
The One-Shot similarity kernel
Wolf, L., Hassner, T., & Taigman, Y. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459323 · Cited by 109
Self-citationBiometric Person Recognition: Face, Speech and Fusion
Sanderson, C. (2008) · Griffith Research Online · Cited by 100
Kernel Grassmannian distances and discriminant analysis for face recognition from image sets
Wang, T., & Shi, P. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2009.06.002 · Cited by 78
The Huller: A Simple and Efficient Online SVM
Bordes, A., & Bottou, L. (2005) · Lecture notes in computer science · doi:10.1007/11564096_48 · Cited by 77
Leveraging archival video for building face datasets
Ramanan, D., Baker, S., & Kakade, S. M. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409012 · Cited by 75
Chellappa, R., & Aggarwal, G. (2007) · International Conference on Image Analysis and Processing · doi:10.1109/iciap.2007.4362805 · Cited by 5
Cited by
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
“Youtube Faces DB [21] is a new dataset that has gained popularity in the face recognition community [17, 15].”
BackgroundArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Self-citationParkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
Metadata
- Authors
- Wolf, L., Hassner, T., & Maoz, I.
- Venue
- CVPR 2011
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 529-534
- OpenAlex
- W2019464758
- Cited by
- 1,382
- References
- 42
- FWCI
- 17.94
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.