The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition
Open accessAbstract
This paper explores multi-task learning (MTL) for face recognition. First, we propose a multi-task convolutional neural network (CNN) for face recognition, where identity classification is the main task and pose, illumination, and expression (PIE) estimations are the side tasks. Second, we develop a dynamic-weighting scheme to automatically assign the loss weights to each side task, which solves the crucial problem of balancing between different tasks in MTL. Third, we propose a pose-directed multi-task CNN by grouping different poses to learn pose-specific identity features, simultaneously across all poses in a joint framework. Last but not least, we propose an energy-based weight analysis method to explore how CNN-based MTL works. We observe that the side tasks serve as regularizations to disentangle the PIE variations from the learnt identity features. Extensive experiments on the entire multi-PIE dataset demonstrate the effectiveness of the proposed approach. To the best of our knowledge, this is the first work using all data in multi-PIE for face recognition. Our approach is also applicable to in-the-wild data sets for pose-invariant face recognition and achieves comparable or better performance than state of the art on LFW, CFP, and IJB-A datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
Convex multi-task feature learning
Argyriou, A., Evgeniou, T., & Pontil, M. (2008) · Machine Learning · doi:10.1007/s10994-007-5040-8 · Cited by 1,528
Cross-Stitch Networks for Multi-task Learning
Misra, I., Shrivastava, A., Gupta, A., & Hebert, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.433 · Cited by 1,397
Disentangled Representation Learning GAN for Pose-Invariant Face Recognition
Tran, L., Yin, X., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.141 · Cited by 1,005
Self-citationDeeply learned face representations are sparse, selective, and robust
Sun, Y., Wang, X., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298907 · Cited by 939
Frontal to profile face verification in the wild
Sengupta, S., Chen, J.-C., Castillo, C., Patel, V. M., Chellappa, R., & Jacobs, D. W. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477558 · Cited by 805
Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A
Klare, B. F., Klein, B., Taborsky, E., Blanton, A., Cheney, J., Allen, K., Grother, P., Mah, A., Burge, M., & Jain, A. K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298803 · Cited by 701
Chen, D., Cao, X., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.389 · Cited by 615
Effective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613
An accelerated gradient method for trace norm minimization
Ji, S., & Ye, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553434 · Cited by 517
Fisher Vector Faces in the Wild
Simonyan, K., Parkhi, O., Vedaldi, A., & Zisserman, A. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.8 · Cited by 445
Learning Deep Representation for Face Alignment with Auxiliary Attributes
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2469286 · Cited by 424
Pedestrian detection aided by deep learning semantic tasks
Tian, Y., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299143 · Cited by 407
A Comprehensive Survey on Pose-Invariant Face Recognition
Ding, C., & Tao, D. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2845089 · Cited by 329
Deep Learning Identity-Preserving Face Space
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.21 · Cited by 312
Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting
Jourabloo, A., & Liu, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.454 · Cited by 296
Self-citationUnconstrained face verification using deep CNN features
Chen, J.-C., Patel, V. M., & Chellappa, R. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477557 · Cited by 269
Multi-Task Pose-Invariant Face Recognition
Ding, C., Xu, C., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2390959 · Cited by 265
Multi-Task CNN Model for Attribute Prediction
Abdulnabi, A. H., Wang, G., Lu, J., & Jia, K. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477680 · Cited by 262
Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses
Kan, M., Shan, S., Chang, H., & Chen, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.243 · Cited by 243
Fully automatic pose-invariant face recognition via 3D pose normalization
Asthana, A., Marks, T. K., Jones, M. J., Tieu, K. H., & Rohith, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126336 · Cited by 243
Pose-Aware Face Recognition in the Wild
Masi, I., Rawls, S., Medioni, G., & Natarajan, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.523 · Cited by 240
Improving multiview face detection with multi-task deep convolutional neural networks
Zhang, C., & Zhang, Z. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6835990 · Cited by 208
Triplet probabilistic embedding for face verification and clustering
Sankaranarayanan, S., Alavi, A., Castillo, C. D., & Chellappa, R. (2016) · 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2016.7791205 · Cited by 164
Sparse Variation Dictionary Learning for Face Recognition with a Single Training Sample per Person
Yang, M., Gool, L. V., & Zhang, L. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.91 · Cited by 156
Wang, D., Otto, C., & Jain, A. K. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2582166 · Cited by 114
Conditional Convolutional Neural Network for Modality-Aware Face Recognition
Xiong, C., Zhao, X., Tang, D., Jayashree, K., Yan, S., & Kim, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.418 · Cited by 93
Pose-Invariant Face Alignment via CNN-Based Dense 3D Model Fitting
Jourabloo, A., & Liu, X. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1012-z · Cited by 91
Self-citation3D-Aided Face Recognition Robust to Expression and Pose Variations
Chu, B., Romdhani, S., & Chen, L. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.245 · Cited by 84
A Scalable Formulation of Probabilistic Linear Discriminant Analysis: Applied to Face Recognition
Shafey, L. E., McCool, C., Wallace, R., & Marcel, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.38 · Cited by 71
Efficient multi-task feature learning with calibration
Gong, P., Zhou, J., Fan, W., & Ye, J. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623641 · Cited by 52
Fisher vector encoded deep convolutional features for unconstrained face verification
Chen, J.-C., Zheng, J., Patel, V. M., & Chellappa, R. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532906 · Cited by 50
Structured feature selection and task relationship inference for multi-task learning
Fei, H., & Huan, J. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-012-0543-4 · Cited by 37
Multi-Task Feature Interaction Learning
Lin, K., Xu, J., Baytaş, İ. M., Ji, S., & Zhou, J. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939834 · Cited by 33
The Multiverse Loss for Robust Transfer Learning
Littwin, E., & Wolf, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.429 · Cited by 25
Interactive Multi-task Relationship Learning
Lin, K., & Zhou, J. (2016) · Proceedings · doi:10.1109/icdm.2016.0035 · Cited by 11
Cited by
Deep face recognition: A survey
Wang, M., & Deng, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.081 · Cited by 996
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
A Review of Face Recognition Technology
Li, L., Mu, X., Li, S., & Peng, H. (2020) · IEEE Access · doi:10.1109/access.2020.3011028 · Cited by 360
Shi, Y., & Jain, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00700 · Cited by 335
Data Uncertainty Learning in Face Recognition
Chang, J., Lan, Z., Cheng, C., & Wei, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00575 · Cited by 320
Metadata
- Authors
- Yin, X., & Liu, X.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2018-02
- Volume
- 27
- Issue
- 2
- Pages
- 964-975
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2588595876
- Cited by
- 255
- References
- 43
- FWCI
- 11.34
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.