The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression
Open accessAbstract
Heatmap regression with a deep network has become one of the mainstream approaches to localize facial landmarks. However, the loss function for heatmap regression is rarely studied. In this paper, we analyze the ideal loss function properties for heatmap regression in face alignment problems. Then we propose a novel loss function, named Adaptive Wing loss, that is able to adapt its shape to different types of ground truth heatmap pixels. This adaptability penalizes loss more on foreground pixels while less on background pixels. To address the imbalance between foreground and background pixels, we also propose Weighted Loss Map, which assigns high weights on foreground and difficult background pixels to help training process focus more on pixels that are crucial to landmark localization. To further improve face alignment accuracy, we introduce boundary prediction and CoordConv with boundary coordinates. Extensive experiments on different benchmarks, including COFW, 300W and WFLW, show our approach outperforms the state-of-the-art by a significant margin on various evaluation metrics. Besides, the Adaptive Wing loss also helps other heatmap regression tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Robust Statistics: The Approach Based on Influence Functions
Ruppert, D. (1987) · Technometrics · doi:10.2307/1269782 · Cited by 3,880
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
2D Human Pose Estimation: New Benchmark and State of the Art Analysis
Andriluka, M., Pishchulin, L., Gehler, P., & Schiele, B. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.471 · Cited by 2,688
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields
Black, M. J., & Anandan, P. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0006 · Cited by 1,570
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Facial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,365
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 1,277
DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model
Insafutdinov, E., Pishchulin, L., Andres, B., Andriluka, M., & Schiele, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_3 · Cited by 1,130
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
Face Alignment at 3000 FPS via Regressing Local Binary Features
Ren, S., Cao, X., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.218 · Cited by 853
Articulated Human Detection with Flexible Mixtures of Parts
Yang, Y., & Ramanan, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.261 · Cited by 852
Face Alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0667-3 · Cited by 851
Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation
Johnson, S., & Everingham, M. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.12 · Cited by 819
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
Liu, R., Lehman, J., Molino, P., Such, F. P., Frank, E., Sergeev, A., & Yosinski, J. (2018) · arXiv · doi:10.48550/arxiv.1807.03247 · Cited by 784 · cited 12×
“[38], we encode into our model the full coordinate information and the information only on boundaries predicted from the previous HG module into our model.”
BackgroundMethodInfluentialRobust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
Black, M. J., & Rangarajan, A. (1996) · International Journal of Computer Vision · doi:10.1007/bf00131148 · Cited by 757
Multi-context Attention for Human Pose Estimation
Chu, X., Yang, W., Ouyang, W., Ma, C., Yuille, A. L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.601 · Cited by 737
Self-citationEffective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613
Look at Boundary: A Boundary-Aware Face Alignment Algorithm
Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., & Zhou, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00227 · Cited by 511
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks
Feng, Z.-H., Kittler, J., Awais, M., Huber, P., & Wu, X.-J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00238 · Cited by 464
Face alignment by coarse-to-fine shape searching
Zhu, S., Li, C., Loy, C. C., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299134 · Cited by 450
Learning Deep Representation for Face Alignment with Auxiliary Attributes
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2469286 · Cited by 424
Neural Aggregation Network for Video Face Recognition
Yang, J., Ren, P., Zhang, D., Chen, D., Wen, F., Li, H., & Hua, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.554 · Cited by 409
Style Aggregated Network for Facial Landmark Detection
Dong, X., Yan, Y., Ouyang, W., & Yang, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00047 · Cited by 339
Mnemonic Descent Method: A Recurrent Process Applied for End-to-End Face Alignment
Trigeorgis, G., Snape, P., Nicolaou, M. A., Antonakos, E., & Zafeiriou, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.453 · Cited by 337
Deep Alignment Network: A Convolutional Neural Network for Robust Face Alignment
Kowalski, M., Naruniec, J., & Trzcinski, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.254 · Cited by 336
Stacked Hourglass Network for Robust Facial Landmark Localisation
Yang, J., Liu, Q., & Zhang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.253 · Cited by 280
Reconstruction of Personalized 3D Face Rigs from Monocular Video
Garrido, P., Zollhöfer, M., Casas, D., Valgaerts, L., Varanasi, K., Pérez, P., & Theobalt, C. (2016) · ACM Transactions on Graphics · doi:10.1145/2890493 · Cited by 260
End-to-End 3D Face Reconstruction with Deep Neural Networks
Dou, P., Shah, S. K., & Kakadiaris, I. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.164 · Cited by 254
Peng, X., Tang, Z., Yang, F., Feris, R. S., & Metaxas, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00237 · Cited by 240
Pose-Aware Face Recognition in the Wild
Masi, I., Rawls, S., Medioni, G., & Natarajan, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.523 · Cited by 240
Lv, J., Shao, X., Xing, J., Cheng, C., & Zhou, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.393 · Cited by 239
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 199
Robust Facial Landmark Detection via Recurrent Attentive-Refinement Networks
Xiao, S., Feng, J., Xing, J., Lai, H., Yan, S., & Kassim, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_4 · Cited by 198
DenseReg: Fully Convolutional Dense Shape Regression In-the-WildPreprint
G\"uler, R. A., Trigeorgis, G., Antonakos, E., Snape, P., Zafeiriou, S. P., & Kokkinos, I. (2016) · arXiv (Cornell University) · Cited by 192
Improving Landmark Localization with Semi-Supervised Learning
Honari, S., Molchanov, P., Tyree, S., Vincent, P., Pal, C., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00167 · Cited by 172
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.400 · Cited by 162
Disentangling 3D Pose in a Dendritic CNN for Unconstrained 2D Face Alignment
Kumar, A., & Chellappa, R. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00052 · Cited by 154
Joint Face Alignment and 3D Face Reconstruction
Liu, F., Zeng, D., Zhao, Q., & Liu, X. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_33 · Cited by 151
Liu, Y., Jourabloo, A., Ren, W., & Liu, X. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.190 · Cited by 144
Quantized Densely Connected U-Nets for Efficient Landmark Localization
Tang, Z., Peng, X., Geng, S., Wu, L., Zhang, S., & Metaxas, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_21 · Cited by 140
Leveraging Intra and Inter-Dataset Variations for Robust Face Alignment
Wu, W., & Yang, S. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.261 · Cited by 125
Face alignment using cascade Gaussian process regression trees
Lee, D., Park, H., & Yoo, C. D. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299048 · Cited by 124
Pose-Invariant Face Alignment with a Single CNN
Jourabloo, A., Ye, M., Liu, X., & Ren, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.347 · Cited by 124
Approaching human level facial landmark localization by deep learning
Fan, H., & Zhou, E. (2015) · Image and Vision Computing · doi:10.1016/j.imavis.2015.11.004 · Cited by 122
Robust Facial Landmark Detection Under Significant Head Poses and Occlusion
Wu, Y., & Ji, Q. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.417 · Cited by 120
Direct Shape Regression Networks for End-to-End Face Alignment
Miao, X., Zhen, X., Liu, X., Deng, C. D., Athitsos, V., & Huang, H. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00529 · Cited by 116
Joint Multi-View Face Alignment in the Wild
Deng, J., Trigeorgis, G., Zhou, Y., & Zafeiriou, S. P. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2899267 · Cited by 116
Unconstrained 3D face reconstruction
Roth, J., Tong, Y., & Liu, X. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298876 · Cited by 106
Feng, Z., Kittler, J., Christmas, W. J., Huber, P., & Wu, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.392 · Cited by 106
Robust Facial Landmark Detection via a Fully-Convolutional Local-Global Context Network
Merget, D., Rock, M., & Rigoll, G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00088 · Cited by 105
A Deeply-Initialized Coarse-to-fine Ensemble of Regression Trees for Face Alignment
Valle, R., Buenaposada, J. M., Valdés, A., & Baumela, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_36 · Cited by 104
Face Alignment via Regressing Local Binary Features
Ren, S., Cao, X., Wei, Y., & Sun, J. Z. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2518867 · Cited by 103
Bulat, A., & Tzimiropoulos, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_43 · Cited by 74
M3 CSR: Multi-view, multi-scale and multi-component cascade shape regression
Deng, J., Liu, Q., Yang, J., & Tao, D. (2015) · Image and Vision Computing · doi:10.1016/j.imavis.2015.11.005 · Cited by 60
Wu, Y., Shah, S. K., & Kakadiaris, I. A. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.12.002 · Cited by 23
Facial Expression-Aware Face Frontalization
Wang, Y., Yu, H. L., Dong, J., Stevens, B., & Liu, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54187-7_25 · Cited by 18
Cited by
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Autonomous robotic laparoscopic surgery for intestinal anastomosis
Saeidi, H., Opfermann, J. D., Kam, M., Wei, S., Leonard, S., Hsieh, M. H., Kang, J. U., & Krieger, A. (2022) · Science Robotics · doi:10.1126/scirobotics.abj2908 · Cited by 384
She, J., Hu, Y., Shi, H., Wang, J., Shen, Q., & Mei, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00618 · Cited by 264
LUVLi Face Alignment: Estimating Landmarks’ Location, Uncertainty, and Visibility Likelihood
Kumar, A., Marks, T. K., Mou, W., Wang, Y., Jones, M., Cherian, A., Koike-Akino, T., Liu, X., & Feng, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00826 · Cited by 165
Satellite Pose Estimation Competition 2021: Results and Analyses
Park, T. H., Märtens, M., Jawaid, M., Wang, Z., Chen, B., Chin, T.-J., Izzo, D., & D’Amico, S. (2023) · Acta Astronautica · doi:10.1016/j.actaastro.2023.01.002 · Cited by 91
Metadata
- Authors
- Wang, X., Bo, L., & Fuxin, L.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 6970-6980
- OpenAlex
- W2982772166
- Cited by
- 313
- References
- 65
- FWCI
- 11.30
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.