The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Open accessAbstract
Making recognition more reliable under uncontrolled lighting conditions is one of the most important challenges for practical face recognition systems. We tackle this by combining the strengths of robust illumination normalization, local texture-based face representations, distance transform based matching, kernel-based feature extraction and multiple feature fusion. Specifically, we make three main contributions: 1) we present a simple and efficient preprocessing chain that eliminates most of the effects of changing illumination while still preserving the essential appearance details that are needed for recognition; 2) we introduce local ternary patterns (LTP), a generalization of the local binary pattern (LBP) local texture descriptor that is more discriminant and less sensitive to noise in uniform regions, and we show that replacing comparisons based on local spatial histograms with a distance transform based similarity metric further improves the performance of LBP/LTP based face recognition; and 3) we further improve robustness by adding Kernel principal component analysis (PCA) feature extraction and incorporating rich local appearance cues from two complementary sources--Gabor wavelets and LBP--showing that the combination is considerably more accurate than either feature set alone. The resulting method provides state-of-the-art performance on three data sets that are widely used for testing recognition under difficult illumination conditions: Extended Yale-B, CAS-PEAL-R1, and Face Recognition Grand Challenge version 2 experiment 4 (FRGC-204). For example, on the challenging FRGC-204 data set it halves the error rate relative to previously published methods, achieving a face verification rate of 88.1% at 0.1% false accept rate. Further experiments show that our preprocessing method outperforms several existing preprocessors for a range of feature sets, data sets and lighting conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Self-citationNonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,584
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
Face recognition using Laplacianfaces
He, X., Yan, S., Hu, Y., Niyogi, P., & Zhang, H.-J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.55 · Cited by 3,264
Face recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092
A multiscale retinex for bridging the gap between color images and the human observation of scenes
Jobson, D. J., Rahman, Z., & Woodell, G. A. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.597272 · Cited by 3,036
Face recognition by elastic bunch graph matching
Wiskott, L., Fellous, J.-M., Kuiger, N., & von der Malsburg, C. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598235 · Cited by 2,883
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
Face Recognition with Local Binary Patterns
Ahonen, T., Hadid, A., & Pietikäinen, M. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_36 · Cited by 2,462
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.268 · Cited by 2,438
Face recognition: features versus templates
Brunelli, R., & Poggio, T. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.254061 · Cited by 2,436
Acquiring linear subspaces for face recognition under variable lighting
Lee, K.-C., Ho, J., & Kriegman, D. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.92 · Cited by 2,391
Low-dimensional procedure for the characterization of human faces
Sirovich, L., & Kirby, M. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000519 · Cited by 2,311
Score normalization in multimodal biometric systems
Jain, A., Nandakumar, K., & Ross, A. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.012 · Cited by 2,154
Distance transformations in digital images
Borgefors, G. (1986) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(86)80047-0 · Cited by 1,898
Distortion invariant object recognition in the dynamic link architecture
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,805
Face Recognition by Elastic Bunch Graph Matching*†
Wiskott, L., Fellous, J.-M., Krüger, N., & von der Malsburg, C. (2022) · INTELLIGENT BIOMETRIC TECHNIQUES in FINGERPRINT and FACE RECOGNITION · doi:10.1201/9780203750520-11 · Cited by 1,781
Lambertian reflectance and linear subspaces
Basri, R., & Jacobs, D. W. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1177153 · Cited by 1,576
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition
Tao, D., Li, X., Wu, X., & Maybank, S. J. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1096 · Cited by 1,140
Face recognition: the problem of compensating for changes in illumination direction
Adini, Y., Moses, Y., & Ullman, S. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598229 · Cited by 1,059
Zhang, W., Shan, S., Gao, W., Chen, X., & Zhang, H. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.147 · Cited by 1,024
Yang, J., Frangi, A. F., Yang, J.-Y., Zhang, D., & Jin, Z. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.33 · Cited by 826
The CAS-PEAL large-scale chinese face database and baseline evaluations
Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., & Zhao, D. (2008) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2007.909557 · Cited by 773
Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Tan, X., & Triggs, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75690-3_13 · Cited by 604
Self-citationGabor-based kernel pca with fractional power polynomial models for face recognition
Liu, C. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273927 · Cited by 585
Zhang, B., Shan, S., Chen, X., & Gao, W. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.884956 · Cited by 580
A method of combining multiple experts for the recognition of unconstrained handwritten numerals
Huang, Y. S., & Suen, C. Y. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.368145 · Cited by 564
What Is the Set of Images of an Object Under All Possible Illumination Conditions?
Belhumeur, P. N., & Kriegman, D. J. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008005721484 · Cited by 525
Total variation models for variable lighting face recognition
Chen, T., Yin, W., Zhou, X. S., Comaniciu, D., & Huang, T. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.195 · Cited by 437
Texture classification using texture spectrum
Wang, L., & He, D.-C. (1990) · Pattern Recognition · doi:10.1016/0031-3203(90)90135-8 · Cited by 420
Patch Alignment for Dimensionality Reduction
Zhang, T., Tao, D., Li, X., & Yang, J. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.212 · Cited by 381
Illumination normalization for robust face recognition against varying lighting conditions
Shan, S., Gao, W., Cao, B., & Zhao, D. (2003) · 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443) · doi:10.1109/amfg.2003.1240838 · Cited by 358
An Image Preprocessing Algorithm for Illumination Invariant Face Recognition
Gross, R., & Brajovic, V. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-44887-x_2 · Cited by 343
In search of illumination invariants
Chen, H. F., Belhumeur, P. N., & Jacobs, D. W. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855827 · Cited by 312
Fusing Gabor and LBP Feature Sets for Kernel-Based Face Recognition
Tan, X., & Triggs, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75690-3_18 · Cited by 282
Self-citationGabor-Based Region Covariance Matrices for Face Recognition
Pang, Y., Yuan, Y., & Li, X. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.924108 · Cited by 277
A shape- and texture-based enhanced Fisher classifier for face recognition
Liu, C., & Wechsler, H. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.913594 · Cited by 261
Liu, C. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.90 · Cited by 250
Tan, X., Chen, S., Zhou, Z.-H., & Zhang, F. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.849817 · Cited by 244
Self-citationLocal Binary Patterns as an Image Preprocessing for Face Authentication
Heusch, G., Rodriguez, Y., & Marcel, S. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.72 · Cited by 190
Recognition of Faces in Unconstrained Environments: A Comparative Study
Ruiz-del-Solar, J., Verschae, R., & Correa, M. (2009) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2009/184617 · Cited by 182
Mode Switching for the Multi-Antenna Broadcast Channel Based on Delay and Channel Quantization
Zhang, J., Heath, R. W., Kountouris, M., & Andrews, J. G. (2009) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2009/802548 · Cited by 172
Face recognition system using local autocorrelations and multiscale integration
Goudail, F., Lange, E., Iwamoto, T., Kyuma, K., & Otsu, N. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.541411 · Cited by 161
Face recognition under variable lighting using harmonic image exemplars
Zhang, L., & Samaras, D. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211333 · Cited by 141
Face Authentication Using Adapted Local Binary Pattern Histograms
Rodriguez, Y., & Marcel, S. (2006) · Lecture notes in computer science · doi:10.1007/11744085_25 · Cited by 88
A comparison of photometric normalisation algorithms for face verification
Short, J., Kittler, J., & Messer, K. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301540 · Cited by 80
Enhanced Pictorial Structures for precise eye localization under incontrolled conditions
Tan, X., Song, F., Zhou, Z., & Chen, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206818 · Cited by 60
Self-citationIterative Subspace Analysis Based on Feature Line Distance
Pang, Y., Yuan, Y., & Li, X. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011167 · Cited by 52
Exploring Feature Descritors for Face Recognition
Yan, S., Wang, H., Tang, X., & Huang, T. S. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.365986 · Cited by 46
Cited by
A Completed Modeling of Local Binary Pattern Operator for Texture Classification
Guo, Z., Zhang, L., & Zhang, D. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2044957 · Cited by 2,115
Enhanced Computer Vision With Microsoft Kinect Sensor: A Review
Han, J., Shao, L., Xu, D., & Shotton, J. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2265378 · Cited by 1,367
PCANet: A Simple Deep Learning Baseline for Image Classification?
Chan, T.-H., Jia, K., Gao, S., Lu, J., Zeng, Z., & Ma, Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2475625 · Cited by 1,362
WLD: A Robust Local Image Descriptor
Chen, J., Shan, S., He, C., Zhao, G., Pietikäinen, M., Chen, X., & Gao, W. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.155 · Cited by 1,024
Song, K., & Yan, Y. (2013) · Applied Surface Science · doi:10.1016/j.apsusc.2013.09.002 · Cited by 1,026
Metadata
- Authors
- Tan, X., & Triggs, B.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2010-06
- Volume
- 19
- Issue
- 6
- Pages
- 1635-1650
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2131081720
- Cited by
- 2,842
- References
- 56
- FWCI
- 180.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.