The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Learning Deep Representation for Face Alignment with Auxiliary Attributes
Open accessAbstract
In this study, we show that landmark detection or face alignment task is not a single and independent problem. Instead, its robustness can be greatly improved with auxiliary information. Specifically, we jointly optimize landmark detection together with the recognition of heterogeneous but subtly correlated facial attributes, such as gender, expression, and appearance attributes. This is non-trivial since different attribute inference tasks have different learning difficulties and convergence rates. To address this problem, we formulate a novel tasks-constrained deep model, which not only learns the inter-task correlation but also employs dynamic task coefficients to facilitate the optimization convergence when learning multiple complex tasks. Extensive evaluations show that the proposed task-constrained learning (i) outperforms existing face alignment methods, especially in dealing with faces with severe occlusion and pose variation, and (ii) reduces model complexity drastically compared to the state-of-the-art methods based on cascaded deep model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Self-citationCootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Deep Learning Face Representation from Predicting 10,000 Classes
Sun, Y., Wang, X., & Tang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.244 · Cited by 1,997
Self-citationSupervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
(1992) · Cited by 1,405
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.446 · Cited by 1,382
Self-citationFacial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,365
Self-citationGupta, A. K., & Nagar, D. K. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9780203749289 · Cited by 1,295
XM2VTSDB: The Extended M2VTS Database
Messer, K., Matas, J., Kittler, J., Luettin, J., & Maître, G. (1999) · Cited by 1,158
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Automatic early stopping using cross validation: quantifying the criteria
Prechelt, L. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00010-0 · Cited by 990
Interactive Facial Feature Localization
Le, V., Brandt, J., Lin, Z., Bourdev, L., & Huang, T. S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_49 · Cited by 920
Robust Face Detection Using the Hausdorff Distance
Jesorsky, O., Kirchberg, K. J., & Frischholz, R. W. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45344-x_14 · Cited by 894
Face Alignment at 3000 FPS via Regressing Local Binary Features
Ren, S., Cao, X., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.218 · Cited by 853
Face Alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0667-3 · Cited by 851
Robust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Locating Facial Features with an Extended Active Shape Model
Milborrow, S., & Nicolls, F. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_37 · Cited by 620
Robust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
Dollar, P., Welinder, P., & Perona, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540094 · Cited by 528
Localizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Cumulative Attribute Space for Age and Crowd Density Estimation
Chen, K., Gong, S., Xiang, T., & Loy, C. C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.319 · Cited by 453
Self-citationFace alignment by coarse-to-fine shape searching
Zhu, S., Li, C., Loy, C. C., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299134 · Cited by 450
Self-citationRobust Visual Tracking via Structured Multi-Task Sparse Learning
Zhang, T., Ghanem, B., Liu, S., & Ahuja, N. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0582-z · Cited by 426
Joint Cascade Face Detection and Alignment
Chen, D., Ren, S., Wei, Y., Cao, X., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_8 · Cited by 405
The Concave-Convex Procedure (CCCP)
Yuille, A., & Rangarajan, A. (2001) · Cited by 397
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390303 · Cited by 380
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Real-time facial feature detection using conditional regression forests
Dantone, M., Gall, J., Fanelli, G., & Van Gool, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247976 · Cited by 368
Face alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248015 · Cited by 364
Deep Learning Identity-Preserving Face Space
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.21 · Cited by 312
Self-citationFacial point detection using boosted regression and graph models
Valstar, M., Martinez, B., Binefa, X., & Pantic, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539996 · Cited by 307
Surpassing Human-Level Face Verification Performance on LFW with GaussianFace
Lu, C., & Tang, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9797 · Cited by 303
Self-citationReal-time visual tracking using compressive sensing
Li, H., Shen, C., & Shi, Q. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995483 · Cited by 297
Robust and Accurate Shape Model Fitting Using Random Forest Regression Voting
Cootes, T. F., Ionita, M. C., Lindner, C., & Sauer, P. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33786-4_21 · Cited by 297
Multi-source Deep Learning for Human Pose Estimation
Ouyang, W., Chu, X., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.299 · Cited by 262
Pose-Free Facial Landmark Fitting via Optimized Part Mixtures and Cascaded Deformable Shape Model
Yu, X., Huang, J., Zhang, S., Yan, W., & Metaxas, D. N. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.244 · Cited by 233
Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild
Tzimiropoulos, G., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.239 · Cited by 215
Heterogeneous Multi-task Learning for Human Pose Estimation with Deep Convolutional Neural Network
Li, S., Liu, Z.-Q., & Chan, A. B. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0767-8 · Cited by 185
Hierarchical face parsing via deep learning
Luo, P., Wang, X., & Tang, X. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247963 · Cited by 181
Self-citationAhmed, A. A., Yu, K., Xu, W. H., Gong, Y., & Xing, E. P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_6 · Cited by 154
A Convex Formulation for Learning Task Relationships in Multi-Task LearningPreprint
Zhang, Y., & Yeung, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.3536 · Cited by 130
Recover Canonical-View Faces in the Wild with Deep Neural NetworksPreprint
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.3543 · Cited by 119
Self-citationGeneric Face Alignment using Boosted Appearance Model
Liu, X. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383265 · Cited by 110
A Deep Sum-Product Architecture for Robust Facial Attributes Analysis
Luo, P., Wang, X., & Tang, X. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.356 · Cited by 84
Self-citationSieving Regression Forest Votes for Facial Feature Detection in the Wild
Yang, H., & Patras, I. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.243 · Cited by 72
Coupling Alignments with Recognition for Still-to-Video Face Recognition
Huang, Z., Zhao, X., Shan, S., Wang, R., & Chen, X. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.409 · Cited by 37
Deep Learning Multi-View Representation for Face RecognitionPreprint
Zhu, Z., Luo, P., Wang, X., & Tang, X. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6947 · Cited by 30
Self-citationDeep Regression for Face AlignmentPreprint
Shi, B., Bai, X., Liu, W., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5230 · Cited by 23
Using a Deformation Field Model for Localizing Faces and Facial Points under Weak Supervision
Pedersoli, M., Timofte, R., Tuytelaars, T., et al. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.472 · Cited by 11
Towards an Intelligent Algorithm for Profile Authentication and Identification
Jerónimo, N., Portela, F., & Santos, H. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.slate.2024.10 · Cited by 1
Cited by
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Look at Boundary: A Boundary-Aware Face Alignment Algorithm
Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., & Zhou, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00227 · Cited by 511
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
Facial Landmark Detection: A Literature Survey
Wu, Y., & Ji, Q. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1097-z · Cited by 404
Face Alignment in Full Pose Range: A 3D Total Solution
Zhu, X., Liu, X., Lei, Z., & Li, S. Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778152 · Cited by 391
Metadata
- Authors
- Zhang, Z., Luo, P., Loy, C. C., & Tang, X.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-05-01
- Volume
- 38
- Issue
- 5
- Pages
- 918-930
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W1795776638
- Cited by
- 424
- References
- 64
- FWCI
- 41.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.