The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Effective Unconstrained Face Recognition by Combining Multiple Descriptors and Learned Background Statistics
Abstract
Computer vision systems have demonstrated considerable improvement in recognizing and verifying faces in digital images. Still, recognizing faces appearing in unconstrained, natural conditions remains a challenging task. In this paper, we present a face-image, pair-matching approach primarily developed and tested on the "Labeled Faces in the Wild" (LFW) benchmark that reflects the challenges of face recognition from unconstrained images. The approach we propose makes the following contributions. 1) We present a family of novel face-image descriptors designed to capture statistics of local patch similarities. 2) We demonstrate how unlabeled background samples may be used to better evaluate image similarities. To this end, we describe a number of novel, effective similarity measures. 3) We show how labeled background samples, when available, may further improve classification performance, by employing a unique pair-matching pipeline. We present state-of-the-art results on the LFW pair-matching benchmarks. In addition, we show our system to be well suited for multilabel face classification (recognition) problem, on both the LFW images and on images from the laboratory controlled multi-PIE database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,584
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
The FERET evaluation methodology for face-recognition algorithms
Phillips, P. J., Moon, H., Rizvi, S. A., & Rauss, P. J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879790 · Cited by 3,692
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Face recognition by elastic bunch graph matching
Wiskott, L., Fellous, J.-M., Kuiger, N., & von der Malsburg, C. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598235 · Cited by 2,883
Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Tan, X., & Triggs, B. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042645 · Cited by 2,842
Distance Metric Learning with Application to Clustering with Side-Information
Xing, E. P., Jordan, M. I., Russell, S., & Ng, A. Y. (2002) · Cited by 2,700
Barker, L. (2002) · Technometrics · doi:10.1198/tech.2002.s659 · Cited by 2,477
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.268 · Cited by 2,438
Face recognition: features versus templates
Brunelli, R., & Poggio, T. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.254061 · Cited by 2,436
Information-theoretic metric learning
Davis, J. V., Kulis, B., Jain, P., Sra, S., & Dhillon, I. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273523 · Cited by 2,006
Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search
Jegou, H., Douze, M., & Schmid, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_24 · Cited by 1,901 · cited 2×
“We used the Hessian-Affine extractor and the SIFT [52] descriptor code made available by [67] to produce descriptors.”
The CMU pose, illumination, and expression database
Sim, T., Baker, S., & Bsat, M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251154 · Cited by 1,783
Face Recognition by Elastic Bunch Graph Matching*†
Wiskott, L., Fellous, J.-M., Krüger, N., & von der Malsburg, C. (2022) · INTELLIGENT BIOMETRIC TECHNIQUES in FINGERPRINT and FACE RECOGNITION · doi:10.1201/9780203750520-11 · Cited by 1,781
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · Cited by 1,690
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition
Zhang, H., Berg, A. C., Maire, M., & Malik, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.301 · Cited by 1,114
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
Integrating constraints and metric learning in semi-supervised clustering
Bilenko, M., Basu, S., & Mooney, R. J. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015360 · Cited by 849
Cristianini, N., Kandola, J., Elisseeff, A., & Shawe-Taylor, J. (2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/3-540-33486-6_8 · Cited by 837
Is that you? Metric learning approaches for face identification
Guillaumin, M., Verbeek, J., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459197 · Cited by 757
Transductive learning via spectral graph partitioning
Joachims, T. (2003) · Cited by 633
Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Tan, X., & Triggs, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75690-3_13 · Cited by 604
Shape Context: A New Descriptor for Shape Matching and Object Recognition
Belongie, S., Malik, J., & Puzicha, J. (2000) · Cited by 511
Fast low-rank modifications of the thin singular value decomposition
Brand, M. (2006) · Linear Algebra and its Applications · doi:10.1016/j.laa.2005.07.021 · Cited by 491
Cristianini, N., Shawe-Taylor, J., Elisseeff, A., & Kandola, J. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0052 · Cited by 474
Representation and Recognition in Vision
Edelman, S. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/5890.001.0001 · Cited by 466
Descriptor Based Methods in the Wild
Wolf, L., Hassner, T., & Taigman, Y. (2008) · HAL · Cited by 444
Self-citationLearning distance functions using equivalence relations
Bar-Hillel, A., Hertz, T., Shental, N., & Weinshall, D. (2003) · Cited by 433
FRVT 2006 and ICE 2006 large-scale results
Phillips, P. J., Scruggs, W. T., O'Toole, A. J., Flynn, P. J., Boyer, K. W., Schott, C. L., & Sharpe, M. (2007) · doi:10.6028/nist.ir.7408 · Cited by 418
FRVT 2006 and ICE 2006 Large-Scale Experimental Results
Phillips, P. J., Scruggs, W. T., O'Toole, A. J., Flynn, P. J., Bowyer, K. W., Schott, C. L., & Sharpe, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.59 · Cited by 406
Description of Interest Regions with Center-Symmetric Local Binary Patterns
Heikkilä, M., Pietikäinen, M., & Schmid, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11949619_6 · Cited by 348
Unsupervised Joint Alignment of Complex Images
Huang, G. B., Jain, V., & Learned-Miller, E. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408858 · Cited by 339
Ojala, T., Pietikäinen, M., & Mäenpää, T. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44732-6_41 · Cited by 319
Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference
Sanderson, C., & Lovell, B. C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01793-3_21 · Cited by 301
Similarity Scores Based on Background Samples
Wolf, L., Hassner, T., & Taigman, Y. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12304-7_9 · Cited by 279
Self-citationFast image search for learned metrics
Jain, P., Kulis, B., & Grauman, K. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587841 · Cited by 279
Fast Similarity Search for Learned Metrics
Kulis, B., Jain, P., & Grauman, K. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.151 · Cited by 256
Transfer learning for image classification with sparse prototype representations
Quattoni, A., Collins, M., & Darrell, T. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587637 · Cited by 252
Object Classification from a Single Example Utilizing Class Relevance Metrics
Fink, M. (2004) · Cited by 206
How far can you get with a modern face recognition test set using only simple features?
Pinto, N., DiCarlo, J. J., & Cox, D. D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206605 · Cited by 196
Multiple One-Shots for Utilizing Class Label Information
Taigman, Y., Wolf, L., & Hassner, T. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.77 · Cited by 173
Self-citationLearning Visual Similarity Measures for Comparing Never Seen Objects
Nowak, E., & Jurie, F. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382969 · Cited by 173
Preliminary Face Recognition Grand Challenge Results
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., & Worek, W. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.87 · Cited by 167
Using Biologically Inspired Features for Face Processing
Meyers, E. M., & Wolf, L. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-007-0058-8 · Cited by 143
Self-citationThe One-Shot similarity kernel
Wolf, L., Hassner, T., & Taigman, Y. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459323 · Cited by 109
Self-citationExtracting Relevant Structures with Side Information
Chechik, G., & Tishby, N. (2002) · Cited by 95
The Huller: A Simple and Efficient Online SVM
Bordes, A., & Bottou, L. (2005) · Lecture notes in computer science · doi:10.1007/11564096_48 · Cited by 77
Object Classification Using a Fragment-Based Representation
Ullman, S., & Sali, E. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45482-9_8 · Cited by 50
Single-example learning of novel classes using representation by similarity
Bart, E., & Ullman, S. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.82 · Cited by 43
Patch-Based Texture Edges and Segmentation
Wolf, L., Huang, X., Martin, I., & Metaxas, D. (2006) · Lecture notes in computer science · doi:10.1007/11744047_37 · Cited by 39
Self-citationExtracting Structures in Image Collections for Object Recognition
Ebert, S., Larlus, D., & Schiele, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_52 · Cited by 33
Cited by
PCANet: A Simple Deep Learning Baseline for Image Classification?
Chan, T.-H., Jia, K., Gao, S., Lu, J., Zeng, Z., & Ma, Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2475625 · Cited by 1,362
Age and Gender Estimation of Unfiltered Faces
Eidinger, E., Enbar, R., & Hassner, T. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2359646 · Cited by 809
Self-citationEffective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613
Self-citationLabeled Faces in the Wild: A Survey
Learned-Miller, E., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Advances in Face Detection and Facial Image Analysis · doi:10.1007/978-3-319-25958-1_8 · Cited by 457
Trunk-Branch Ensemble Convolutional Neural Networks for Video-Based Face Recognition
Ding, C., & Tao, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2700390 · Cited by 441
Metadata
- Authors
- Wolf, L., Hassner, T., & Taigman, Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-10
- Volume
- 33
- Issue
- 10
- Pages
- 1978-1990
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2098017479
- Cited by
- 333
- References
- 65
- FWCI
- 16.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.