The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Robust Face Landmark Estimation under Occlusion
Abstract
Human faces captured in real-world conditions present large variations in shape and occlusions due to differences in pose, expression, use of accessories such as sunglasses and hats and interactions with objects (e.g. food). Current face landmark estimation approaches struggle under such conditions since they fail to provide a principled way of handling outliers. We propose a novel method, called Robust Cascaded Pose Regression (RCPR) which reduces exposure to outliers by detecting occlusions explicitly and using robust shape-indexed features. We show that RCPR improves on previous landmark estimation methods on three popular face datasets (LFPW, LFW and HELEN). We further explore RCPR's performance by introducing a novel face dataset focused on occlusion, composed of 1,007 faces presenting a wide range of occlusion patterns. RCPR reduces failure cases by half on all four datasets, at the same time as it detects face occlusions with a 80/40% precision/recall.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Kass, M., Witkin, A., & Terzopoulos, D. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133570 · Cited by 17,070
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Automated Flower Classification over a Large Number of Classes
Nilsback, M.-E., & Zisserman, A. (2008) · 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing · doi:10.1109/icvgip.2008.47 · Cited by 3,442 · cited 1×
“Accurate object shape computation is key to many visual tasks; for instance, classification of facial expression [17, 30], facial identity [38], action analysis [4], and fine-grained categorization [34, 3, 18, 40] require accurate registration of a (deformable, part-based) model to the image.”
BackgroundDetecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Active Appearance Models Revisited
Matthews, I., & Baker, S. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029666.37597.d3 · Cited by 1,535
Feature extraction from faces using deformable templates
Yuille, A. L., Hallinan, P. W., & Cohen, D. S. (1992) · International Journal of Computer Vision · doi:10.1007/bf00127169 · Cited by 1,369
Head Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
Poselets: Body part detectors trained using 3D human pose annotations
Bourdev, L., & Malik, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459303 · Cited by 961
Interactive Facial Feature Localization
Le, V., Brandt, J., Lin, Z., Bourdev, L., & Huang, T. S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_49 · Cited by 920
Robust Face Detection Using the Hausdorff Distance
Jesorsky, O., Kirchberg, K. J., & Frischholz, R. W. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45344-x_14 · Cited by 894
Face Alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0667-3 · Cited by 851
Leafsnap: A Computer Vision System for Automatic Plant Species Identification
Kumar, N., Belhumeur, P. N., Biswas, A., Jacobs, D. W., Kress, W. J., Lopez, I. C., & Soares, J. V. B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_36 · Cited by 802
Deformable Model Fitting by Regularized Landmark Mean-Shift
Saragih, J. M., Lucey, S., & Cohn, J. F. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0380-4 · Cited by 787
Active Shape Models — ‘Smart Snakes’
Cootes, T. F., & Taylor, C. J. (1992) · BMVC92 · doi:10.1007/978-1-4471-3201-1_28 · Cited by 661
Locating Facial Features with an Extended Active Shape Model
Milborrow, S., & Nicolls, F. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_37 · Cited by 620
Fast Keypoint Recognition Using Random Ferns
Ozuysal, M., Calonder, M., Lepetit, V., & Fua, P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.23 · Cited by 595
Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video
Everingham, M. R., Sivic, J., & Zisserman, A. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.92 · Cited by 552
Dollar, P., Welinder, P., & Perona, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540094 · Cited by 528
Self-citationLocalizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
Visual Recognition with Humans in the Loop
Branson, S., Wah, C., Schroff, F., Babenko, B., Welinder, P., Perona, P., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_32 · Cited by 402
Self-citationGross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2008) · 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition · doi:10.1109/afgr.2008.4813399 · Cited by 373
Real-time facial feature detection using conditional regression forests
Dantone, M., Gall, J., Fanelli, G., & Van Gool, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247976 · Cited by 368
Face alignment by Explicit Shape Regression
Cao, X., Wei, Y., Wen, F., & Sun, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248015 · Cited by 364
3D shape regression for real-time facial animation
Cao, C., Weng, Y., Lin, S., & Zhou, K. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462012 · Cited by 348
Elliott, D. (2010) · Cited by 312
Facial point detection using boosted regression and graph models
Valstar, M., Martinez, B., Binefa, X., & Pantic, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539996 · Cited by 307
A probabilistic approach to object recognition using local photometry and global geometry
Burl, M. C., Weber, M., & Perona, P. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0054769 · Cited by 238
Self-citation“Who are you?” - Learning person specific classifiers from video
Sivic, J., Everingham, M., & Zisserman, A. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206513 · Cited by 223
Boosting Methods for Regression
Duffy, N., & Helmbold, D. (2002) · Machine Learning · doi:10.1023/a:1013685603443 · Cited by 183
Social behavior recognition in continuous video
Burgos-Artizzu, X. P., Dollár, P., Lin, D., Anderson, D. J., & Perona, P. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247817 · Cited by 180
Self-citationMartinez, A. M., & Du, S. (2017) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-57021-1_6 · Cited by 173
Tf, C., & Taylor, C. (1992) · Cited by 161
Boosted Regression Active Shape Models
Cristinacce, D., & Cootes, T. F. (2007) · British Machine Vision Conference (BMVC) · doi:10.5244/c.21.79 · Cited by 154
Ding, L., & Martínez, A. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.28 · Cited by 138
Accurate Regression Procedures for Active Appearance Models
Sauer, P., Cootes, T. F., & Taylor, C. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.30 · Cited by 103
Klarreich, E. (2014) · Communications of the ACM · doi:10.1145/2632040 · Cited by 93
Recognizing proxemics in personal photos
Yang, Y., Baker, S., Kannan, A., & Ramanan, D. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248095 · Cited by 87
Stationary Features and Cat Detection
Fleuret, F., & Geman, D. (2007) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 62
Privileged information-based conditional regression forest for facial feature detection
Yang, H., & Patras, I. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553766 · Cited by 56
Viewpoint-invariant learning and detection of human heads
Weber, M., Wolfgang Einhäuser, A., Welling, M., & Perona, P. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840607 · Cited by 48
Self-citationFace and landmark detection by using cascade of classifiers
Çevıkalp, H., Triggs, B., & Franc, V. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553705 · Cited by 39
Tam, V. W. L., Santoso, A., & Setiono, R. (2003) · doi:10.1109/icpr.2002.1044665 · Cited by 35
Cited by
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
OpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Facial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,365
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Metadata
- Authors
- Burgos-Artizzu, X. P., Perona, P., & Dollar, P.
- Venue
- 2013 IEEE International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2013-12
- Pages
- 1513-1520
- OpenAlex
- W2111372597
- Cited by
- 775
- References
- 47
- FWCI
- 40.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.