The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks
Open accessAbstract
We present a new loss function, namely Wing loss, for robust facial landmark localisation with Convolutional Neural Networks (CNNs). We first compare and analyse different loss functions including L2, L1 and smooth L1. The analysis of these loss functions suggests that, for the training of a CNN-based localisation model, more attention should be paid to small and medium range errors. To this end, we design a piece-wise loss function. The new loss amplifies the impact of errors from the interval (-w, w) by switching from L1 loss to a modified logarithm function. To address the problem of under-representation of samples with large out-of-plane head rotations in the training set, we propose a simple but effective boosting strategy, referred to as pose-based data balancing. In particular, we deal with the data imbalance problem by duplicating the minority training samples and perturbing them by injecting random image rotation, bounding box translation and other data augmentation approaches. Last, the proposed approach is extended to create a two-stage framework for robust facial landmark localisation. The experimental results obtained on AFLW and 300W demonstrate the merits of the Wing loss function, and prove the superiority of the proposed method over the state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Robust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228
Self-citationActive Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild
Li, S., Deng, W., & Du, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.277 · Cited by 1,470
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.446 · Cited by 1,382
Facial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,365
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 1,277
XM2VTSDB: The Extended M2VTS Database
Messer, K., Matas, J., Kittler, J., Luettin, J., & Maître, G. (1999) · Cited by 1,158
Self-citationFace Alignment Across Large Poses: A 3D Solution
Zhu, X., Lei, Z., Liu, X., Shi, H., & Li, S. Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.23 · Cited by 1,137
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Interactive Facial Feature Localization
Le, V., Brandt, J., Lin, Z., Bourdev, L., & Huang, T. S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_49 · Cited by 920
Face Alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0667-3 · Cited by 851
Robust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
Feature Detection and Tracking with Constrained Local Models
Cristinacce, D., & Cootes, T. F. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.95 · Cited by 718
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Benitez-Quiroz, C. F., Srinivasan, R., & Martinez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.600 · Cited by 607
Dollar, P., Welinder, P., & Perona, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540094 · Cited by 528
Localizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Face alignment by coarse-to-fine shape searching
Zhu, S., Li, C., Loy, C. C., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299134 · Cited by 450
Sun, X., Wei, Y., Liang, S., Tang, X., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298683 · Cited by 414
Neural Aggregation Network for Video Face Recognition
Yang, J., Ren, P., Zhang, D., Chen, D., Wen, F., Li, H., & Hua, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.554 · Cited by 409
A Semi-automatic Methodology for Facial Landmark Annotation
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.132 · Cited by 387
View-based active appearance models
Cootes, T. F., Wheeler, G. V., Walker, K. N., & Taylor, C. J. (2002) · Image and Vision Computing · doi:10.1016/s0262-8856(02)00055-0 · Cited by 349
Do We Really Need to Collect Millions of Faces for Effective Face Recognition?
Masi, I., Trần, A. T., Hassner, T., Leksut, J. T., & Medioni, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_35 · Cited by 339
Mnemonic Descent Method: A Recurrent Process Applied for End-to-End Face Alignment
Trigeorgis, G., Snape, P., Nicolaou, M. A., Antonakos, E., & Zafeiriou, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.453 · Cited by 337
Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting
Jourabloo, A., & Liu, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.454 · Cited by 296
Stacked Hourglass Network for Robust Facial Landmark Localisation
Yang, J., Liu, Q., & Zhang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.253 · Cited by 280
End-to-End 3D Face Reconstruction with Deep Neural Networks
Dou, P., Shah, S. K., & Kakadiaris, I. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.164 · Cited by 254
View-based active appearance models
Cootes, T. F., Walker, K., & Taylor, C. J. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840639 · Cited by 249
Pose-Aware Face Recognition in the Wild
Masi, I., Rawls, S., Medioni, G., & Natarajan, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.523 · Cited by 240
Lv, J., Shao, X., Xing, J., Cheng, C., & Zhou, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.393 · Cited by 239
A Multi-View Nonlinear Active Shape Model Using Kernel PCA
Romdhani, S., Gong, S., & Psarrou, A. (1999) · Procedings of the British Machine Vision Conference 1999 · doi:10.5244/c.13.48 · Cited by 211
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 199
Robust Facial Landmark Detection via Recurrent Attentive-Refinement Networks
Xiao, S., Feng, J., Xing, J., Lai, H., Yan, S., & Kassim, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_4 · Cited by 198
Global supervised descent method
Xiong, X., & De la Torre, F. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298882 · Cited by 189
Facial Landmark Detection with Tweaked Convolutional Neural Networks
Wu, Y., Hassner, T., Kim, K., Medioni, G., & Natarajan, P. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2787130 · Cited by 173
Unconstrained Face Alignment via Cascaded Compositional Learning
Zhu, S., Li, C., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.371 · Cited by 171
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.400 · Cited by 162
Liu, Y., Jourabloo, A., Ren, W., & Liu, X. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.190 · Cited by 144
Adaptive 3D Face Reconstruction from Unconstrained Photo Collections
Roth, J., Tong, Y., & Liu, X. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.455 · Cited by 143
Pose-Invariant Face Alignment with a Single CNN
Jourabloo, A., Ye, M., Liu, X., & Ren, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.347 · Cited by 123
Bhagavatula, C., Zhu, C., Luu, K., & Savvides, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.429 · Cited by 114
Deep Deformation Network for Object Landmark Localization
Yu, X., Zhou, F., & Chandraker, M. K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_4 · Cited by 113
Joint Multi-View Face Alignment in the Wild
Deng, J., Trigeorgis, G., Zhou, Y., & Zafeiriou, S. P. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2899267 · Cited by 111
Feng, Z., Kittler, J., Christmas, W. J., Huber, P., & Wu, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.392 · Cited by 106
Self-citationOcclusion-Free Face Alignment: Deep Regression Networks Coupled with De-Corrupt AutoEncoders
Zhang, J., Kan, M., Shan, S., & Chen, X. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.373 · Cited by 101
Face Alignment via Regressing Local Binary Features
Ren, S., Cao, X., Wei, Y., & Sun, J. Z. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2518867 · Cited by 98
Feng, Z., Hu, G., Kittler, J., Christmas, W. J., & Wu, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446944 · Cited by 91
Self-citationSimultaneous Facial Landmark Detection, Pose and Deformation Estimation Under Facial Occlusion
Wu, Y., Gou, C., & Ji, Q. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.606 · Cited by 87
Random Cascaded-Regression Copse for Robust Facial Landmark Detection
Feng, Z., Huber, P., Kittler, J., et al. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2347011 · Cited by 82
Self-citationWu, Y., & Ji, Q. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.370 · Cited by 81
Joint Head Pose Estimation and Face Alignment Framework Using Global and Local CNN Features
Xu, X., & Kakadiaris, I. A. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.81 · Cited by 75
Gaussian mixture 3D morphable face model
Koppen, P., Feng, Z., Kittler, J., Awais, M., Christmas, W. J., Wu, X., & Yin, H.-F. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.006 · Cited by 74
Self-citationEvaluation of Dense 3D Reconstruction from 2D Face Images in the Wild
Feng, Z., Huber, P., Kittler, J., Hancock, P., Wu, X., Zhao, Q., Koppen, P., & Rätsch, M. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00123 · Cited by 61
Self-citationAdaptive 3D Face Reconstruction from Unconstrained Photo Collections
Roth, J., Tong, Y., & Liu, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2636829 · Cited by 51
Copula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity
Walecki, R., Rudovic, O. O., Pavlović, V., & Pantić, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.530 · Cited by 49
Interspecies Knowledge Transfer for Facial Keypoint Detection
Rashid, M., Gu, X., & Lee, Y. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.174 · Cited by 43
Unconstrained Facial Landmark Localization with Backbone-Branches Fully-Convolutional NetworksPreprint
Liang, Z., Ding, S., & Lin, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.03409 · Cited by 31
Adaptive Cascade Deep Convolutional Neural Networks for face alignment
Dong, Y., & Wu, Y. (2015) · Computer Standards & Interfaces · doi:10.1016/j.csi.2015.06.004 · Cited by 30
Wu, Y., Shah, S. K., & Kakadiaris, I. A. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.12.002 · Cited by 23
Cited by
High-Resolution Representations for Labeling Pixels and Regions
Sun, K., Zhao, Y. S., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04514 · Cited by 614
RetinaFace: Single-stage Dense Face Localisation in the Wild
Deng, J., Guo, J., Zhou, Y., Yu, J., Kotsia, I., & Zafeiriou, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.00641 · Cited by 391
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y. S., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07919 · Cited by 326
Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression
Wang, X., Bo, L., & Fuxin, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00707 · Cited by 313
LUVLi Face Alignment: Estimating Landmarks’ Location, Uncertainty, and Visibility Likelihood
Kumar, A., Marks, T. K., Mou, W., Wang, Y., Jones, M., Cherian, A., Koike-Akino, T., Liu, X., & Feng, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00826 · Cited by 165
Metadata
- Authors
- Feng, Z.-H., Kittler, J., Awais, M., Huber, P., & Wu, X.-J.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 2235-2245
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2770121394
- Cited by
- 464
- References
- 74
- FWCI
- 14.62
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.