The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Multi-Task Pose-Invariant Face Recognition
Abstract
Face images captured in unconstrained environments usually contain significant pose variation, which dramatically degrades the performance of algorithms designed to recognize frontal faces. This paper proposes a novel face identification framework capable of handling the full range of pose variations within ±90° of yaw. The proposed framework first transforms the original pose-invariant face recognition problem into a partial frontal face recognition problem. A robust patch-based face representation scheme is then developed to represent the synthesized partial frontal faces. For each patch, a transformation dictionary is learnt under the proposed multi-task learning scheme. The transformation dictionary transforms the features of different poses into a discriminative subspace. Finally, face matching is performed at patch level rather than at the holistic level. Extensive and systematic experimentation on FERET, CMU-PIE, and Multi-PIE databases shows that the proposed method consistently outperforms single-task-based baselines as well as state-of-the-art methods for the pose problem. We further extend the proposed algorithm for the unconstrained face verification problem and achieve top-level performance on the challenging LFW data set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
The FERET evaluation methodology for face-recognition algorithms
Phillips, P. J., Moon, H., Rizvi, S. A., & Rauss, P. J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879790 · Cited by 3,692
Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Tan, X., & Triggs, B. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042645 · Cited by 2,842
Point Set Registration: Coherent Point Drift
Myronenko, A., & Song, X. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.46 · Cited by 2,762
Face recognition based on fitting a 3D morphable model
Blanz, V., & Vetter, T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227983 · Cited by 2,002
The CMU pose, illumination, and expression database
Sim, T., Baker, S., & Bsat, M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251154 · Cited by 1,783
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.446 · Cited by 1,382
A 3D Face Model for Pose and Illumination Invariant Face Recognition
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., & Vetter, T. (2009) · 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance · doi:10.1109/avss.2009.58 · Cited by 1,326
Probabilistic Linear Discriminant Analysis for Inferences About Identity
Prince, S. J. D., & Elder, J. H. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409052 · Cited by 977
Generalized Multiview Analysis: A discriminative latent space
Sharma, A., Kumar, A., Daume, H., & Jacobs, D. W. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247923 · Cited by 714
Chen, D., Cao, X., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.389 · Cited by 615
Face recognition across pose: A review
Zhang, X., & Gao, Y. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.04.017 · Cited by 484
Fisher Vector Faces in the Wild
Simonyan, K., Parkhi, O., Vedaldi, A., & Zisserman, A. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.8 · Cited by 445
Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition
Ding, C., Choi, J., Tao, D., & Davis, L. S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462338 · Cited by 381
Self-citationPatch Alignment for Dimensionality Reduction
Zhang, T., Tao, D., Li, X., & Yang, J. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.212 · Cited by 381
Self-citationXu, H., & Mannor, S. (2012) · Machine Learning · doi:10.1007/s10994-011-5268-1 · Cited by 377
Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch
Sharma, A., & Jacobs, D. W. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995350 · Cited by 376
A Comprehensive Survey to Face Hallucination
Wang, N., Tao, D., Gao, X., Li, X., & Li, J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0645-9 · Cited by 339
Self-citationPartial Face Recognition: Alignment-Free Approach
Liao, S., Jain, A. K., & Li, S. Z. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.191 · Cited by 313
Deep Learning Identity-Preserving Face Space
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.21 · Cited by 312
Locally Linear Regression for Pose-Invariant Face Recognition
Chai, X., Shan, S., Chen, X., & Gao, W. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.899195 · Cited by 272
Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses
Kan, M., Shan, S., Chang, H., & Chen, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.243 · Cited by 243
Fully automatic pose-invariant face recognition via 3D pose normalization
Asthana, A., Marks, T. K., Jones, M. J., Tieu, K. H., & Rohith, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126336 · Cited by 243
Similarity Metric Learning for Face Recognition
Cao, Q., Ying, Y., & Li, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.299 · Cited by 233
Probabilistic Models for Inference about Identity
Li, P., Fu, Y., Mohammed, U., Elder, J. H., & Prince, S. J. D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.104 · Cited by 215
Weakly-Supervised Cross-Domain Dictionary Learning for Visual Recognition
Zhu, F., & Shao, L. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0703-y · Cited by 210
Towards Pose Robust Face Recognition
Yi, D., Lei, Z., & Li, S. Z. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.454 · Cited by 202
Probabilistic Elastic Matching for Pose Variant Face Verification
Li, H., Hua, G., Lin, Z., Brandt, J., & Yang, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.449 · Cited by 199
Multi-view Discriminant Analysis
Kan, M., Shan, S., Zhang, H., Lao, S., & Chen, X. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_58 · Cited by 196
Face Recognition Based on Frontal Views Generated from Non-Frontal Images
Blanz, V., Grother, P., Phillips, P. J., & Vetter, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.150 · Cited by 193
Tied Factor Analysis for Face Recognition across Large Pose Differences
Prince, S. J. D., Warrell, J., Elder, J. H., & Felisberti, F. M. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.48 · Cited by 193
Nonlocal Hierarchical Dictionary Learning Using Wavelets for Image Denoising
Yan, R., Shao, L., & Liu, Y. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2277813 · Cited by 178
Multiple One-Shots for Utilizing Class Label Information
Taigman, Y., Wolf, L., & Hassner, T. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.77 · Cited by 173
Fast High Dimensional Vector Multiplication Face Recognition
Barkan, O., Weill, J., Wolf, L., & Aronowitz, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.246 · Cited by 172
Tracking via Robust Multi-task Multi-view Joint Sparse Representation
Hong, Z., Mei, X., Prokhorov, D. V., & Tao, D. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.86 · Cited by 155
Self-citationCoupled Bias–Variance Tradeoff for Cross-Pose Face Recognition
Li, A., Shan, S., & Gao, W. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2160957 · Cited by 142
Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models
Prabhu, U., Heo, J., & Savvides, M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.123 · Cited by 137
Liu, L., Shao, L., & Rockett, P. I. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.10.004 · Cited by 124
Pose-Invariant Face Recognition Using Markov Random Fields
Ho, H. T., & Chellappa, R. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2233489 · Cited by 123
Learning Object-to-Class Kernels for Scene Classification
Zhang, L., Zhen, X., & Shao, L. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2328894 · Cited by 110
Maximizing intra-individual correlations for face recognition across pose differences
Li, A., Shan, S., Chen, X., & Gao, W. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206659 · Cited by 101
Efficient processing of MRFs for unconstrained-pose face recognition
Arashloo, S. R., & Kittler, J. (2013) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2013.6712721 · Cited by 88
Implicit elastic matching with random projections for pose-variant face recognition
Wright, J. N., & Hua, G. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206786 · Cited by 85
Random Faces Guided Sparse Many-to-One Encoder for Pose-Invariant Face Recognition
Zhang, Y., Shao, M., Wong, E. K., & Fu, Y. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.300 · Cited by 67
The 2013 speaker recognition evaluation in mobile environment
Khoury, E., Vesnicer, B., Franco-Pedroso, J., Violato, R. P. V., Boulkcnafet, Z., Fernández, L. M. M., Díez, M., Kosmala, J., Khemiri, H., Cipr, T., et al. (2013) · International Conference on Biometrics · doi:10.1109/icb.2013.6613025 · Cited by 58
Robust Feature Set Matching for Partial Face Recognition
Weng, R., Lu, J., Hu, J., Yang, G., & Tan, Y. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.80 · Cited by 54
Sparse Feature Extraction for Pose-Tolerant Face Recognition
Abiantun, R., Prabhu, U., & Savvides, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2313124 · Cited by 45
Depth Estimation of Face Images Using the Nonlinear Least-Squares Model
Sun, Z.-L., Lam, K., & Gao, Q. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2204269 · Cited by 43
The 2013 face recognition evaluation in mobile environment
Günther, M., Costa‐Pazo, A., Ding, C., Boutellaa, E., Chiachia, G., Zhang, H., Angeloni, M. D. A., Štruc, V., Khoury, E., Vázquez-Fernández, E., et al. (2013) · International Conference on Biometrics · doi:10.1109/icb.2013.6613024 · Cited by 35
Self-citationLatent Multitask Learning for View-Invariant Action Recognition
Mahasseni, B., & Todorović, S. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.388 · Cited by 33
Arashloo, S. R., & Kittler, J. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.05.017 · Cited by 24
Evolutionary compact embedding for large-scale image classification
Liu, L., Shao, L., & Li, X. (2014) · Information Sciences · doi:10.1016/j.ins.2014.06.030 · Cited by 23
Cited by
Robust Face Recognition via Multimodal Deep Face Representation
Ding, C., & Tao, D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477042 · Cited by 449
Self-citationMulti-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition
Ding, C., Choi, J., Tao, D., & Davis, L. S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462338 · Cited by 381
Self-citationDo We Really Need to Collect Millions of Faces for Effective Face Recognition?
Masi, I., Trần, A. T., Hassner, T., Leksut, J. T., & Medioni, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_35 · Cited by 339
Multimodal Face-Pose Estimation With Multitask Manifold Deep Learning
Hong, C., Yu, J., Zhang, J., Jin, X., & Lee, K.-H. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2884211 · Cited by 313
Metadata
- Authors
- Ding, C., Xu, C., & Tao, D.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2015-03
- Volume
- 24
- Issue
- 3
- Pages
- 980-993
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1983474530
- Cited by
- 265
- References
- 54
- FWCI
- 37.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.