The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results
Open accessAbstract
Detection and tracking of faces in image sequences is among the most well studied problems in the intersection of statistical machine learning and computer vision. Often, tracking and detection methodologies use a rigid representation to describe the facial region 1, hence they can neither capture nor exploit the non-rigid facial deformations, which are crucial for countless of applications (e.g., facial expression analysis, facial motion capture, high-performance face recognition etc.). Usually, the non-rigid deformations are captured by locating and tracking the position of a set of fiducial facial landmarks (e.g., eyes, nose, mouth etc.). Recently, we witnessed a burst of research in automatic facial landmark localisation in static imagery. This is partly attributed to the availability of large amount of annotated data, many of which have been provided by the first facial landmark localisation challenge (also known as 300-W challenge). Even though now well established benchmarks exist for facial landmark localisation in static imagery, to the best of our knowledge, there is no established benchmark for assessing the performance of facial landmark tracking methodologies, containing an adequate number of annotated face videos. In conjunction with ICCV'2015 we run the first competition/challenge on facial landmark tracking in long-term videos. In this paper, we present the first benchmark for long-term facial landmark tracking, containing currently over 110 annotated videos, and we summarise the results of the competition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · cited 3×
“This is mainly attributed to the fact that face tracking is modelled as a face detection or as a general object tracking problem [43, 23, 61, 24].”
BackgroundIncremental Learning for Robust Visual Tracking
Ross, D. A., Lim, J., Lin, R.-S., & Yang, M.-H. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0075-7 · Cited by 3,061
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
Active Appearance Models Revisited
Matthews, I., & Baker, S. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029666.37597.d3 · Cited by 1,535
Visual Tracking: An Experimental Survey
(2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.230 · Cited by 1,513
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Self-citationRobust online appearance models for visual tracking
Jepson, A. D., Fleet, D. J., & El-Maraghi, T. F. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1233903 · Cited by 922
Interactive Facial Feature Localization
Le, V., Brandt, J., Lin, Z., Bourdev, L., & Huang, T. S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_49 · Cited by 920
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
Face Alignment at 3000 FPS via Regressing Local Binary Features
Ren, S., Cao, X., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.218 · Cited by 853
Matthews, L., Ishikawa, T., & Baker, S. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.16 · Cited by 754
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schroder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.20 · Cited by 665
300 Faces In-The-Wild Challenge: Database and results
Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.01.002 · Cited by 638
Self-citationLocalizing Parts of Faces Using a Consensus of Exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.23 · Cited by 522
A survey on face detection in the wild: Past, present and future
Zafeiriou, S., Zhang, C., & Zhang, Z. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.03.015 · Cited by 458
Self-citationRecognizing human facial expressions from long image sequences using optical flow
Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506414 · Cited by 458
Black, M. J., & Yacoob, Y. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466915 · Cited by 457
Incremental Face Alignment in the Wild
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.240 · Cited by 450
Self-citationFace tracking and recognition with visual constraints in real-world videos
Kim, M., Kumar, S., Pavlovic, V., & Rowley, H. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587572 · Cited by 439
Real-time combined 2D+3D active appearance models
Xiao, J., Baker, S., Matthews, I., & Kanade, T. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315210 · Cited by 416
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
DeCarlo, D., & Metaxas, D. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008122917811 · Cited by 299
A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models
Koelstra, S., Pantic, M., & Patras, I. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.50 · Cited by 242
Project-Out Cascaded Regression with an application to face alignment
Tzimiropoulos, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298989 · Cited by 218
Self-citationOptimization Problems for Fast AAM Fitting in-the-Wild
Tzimiropoulos, G., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.79 · Cited by 218
Self-citationGauss-Newton Deformable Part Models for Face Alignment In-the-Wild
Tzimiropoulos, G., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.239 · Cited by 215
Self-citationLAFTER: lips and face real time tracker
Oliver, N., Pentland, A. P., & Berard, F. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609309 · Cited by 199
Global supervised descent method
Xiong, X., & De la Torre, F. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298882 · Cited by 189
A unified approach to coding and interpreting face images
Lanitis, A., Taylor, C. J., & Cootes, T. F. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466919 · Cited by 177
NUS-PRO: A New Visual Tracking Challenge
Li, A., Lin, M., Wu, Y., Yang, M.-H., & Yan, S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2417577 · Cited by 176
Face-TLD: Tracking-Learning-Detection applied to faces
Kalal, Z., Mikolajczyk, K., & Matas, J. (2010) · 2010 IEEE International Conference on Image Processing · doi:10.1109/icip.2010.5653525 · Cited by 167
Face localization and facial feature extraction based on shape and color information
Sobottka, K., & Pitas, I. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1996.560536 · Cited by 153
Modeling, tracking and interactive animation of faces and heads//using input from video
Essa, I. A., Basu, S., Darrell, T., & Pentland, A. (2002) · Computer Animation (CA) · doi:10.1109/ca.1996.540489 · Cited by 143
Menpo: A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models
Alabort-i-Medina, J., Antonakos, E., Booth, J. G., Snape, P., & Zafeiriou, S. P. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654890 · Cited by 118
Self-citationFeature-Based Lucas–Kanade and Active Appearance Models
Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., & Zafeiriou, S. P. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2431445 · Cited by 108
Self-citationOffline Deformable Face Tracking in Arbitrary Videos
Chrysos, G. G., Antonakos, E., Zafeiriou, S. P., & Snape, P. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.126 · Cited by 102
Self-citationParticle filtering with factorized likelihoods for tracking facial features
Patras, I., & Pantić, M. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301515 · Cited by 100
Euler Principal Component Analysis
Liwicki, S., Tzimiropoulos, G., Zafeiriou, S. P., & Pantić, M. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0558-z · Cited by 93
Self-citationAdaptive and constrained algorithms for inverse compositional Active Appearance Model fitting
Papandreou, G., & Maragos, P. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587540 · Cited by 66
Efficient Online Subspace Learning With an Indefinite Kernel for Visual Tracking and Recognition
Liwicki, S., Zafeiriou, S. P., Tzimiropoulos, G., & Pantić, M. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2208654 · Cited by 60
Self-citationFacial Landmark Detection via Progressive Initialization
Xiao, S., Yan, S., & Kassim, A. A. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.130 · Cited by 58
Facial Shape Tracking via Spatio-Temporal Cascade Shape Regression
Yang, J., Deng, J., Zhang, K., & Liu, Q. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.131 · Cited by 53
From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild
Asthana, A., Zafeiriou, S. P., Tzimiropoulos, G., Cheng, S., & Pantić, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2362142 · Cited by 46
Self-citationBayesian Active Appearance Models
Alabort-i-Medina, J., & Zafeiriou, S. P. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.439 · Cited by 46
Self-citationAntonakos, E., Alabort-i-Medina, J., & Zafeiriou, S. P. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299182 · Cited by 42
Self-citationReal-Time Facial Feature Tracking on a Mobile Device
Tresadern, P., Ionita, M. C., & Cootes, T. F. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0464-9 · Cited by 41
RAPS: Robust and Efficient Automatic Construction of Person-Specific Deformable Models
Sagonas, C., Panagakis, Y., Zafeiriou, S. P., & Pantić, M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.231 · Cited by 39
Self-citationHierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises
Orozco, J., Rudovic, O. O., Gonzàlez, J., & Pantić, M. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2013.02.001 · Cited by 39
Shape Augmented Regression Method for Face Alignment
Wu, Y., & Ji, Q. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.129 · Cited by 30
Facial Landmark Tracking by Tree-Based Deformable Part Model Based Detector
Uřičář, M., Franc, V., & Hlaváč, V. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.127 · Cited by 28
Unifying holistic and Parts-Based Deformable Model fitting
Alabort-i-Medina, J., & Zafeiriou, S. P. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298991 · Cited by 27
Self-citationActive Orientation Models for Face Alignment In-the-Wild
Tzimiropoulos, G., Alabort-i-Medina, J., Zafeiriou, S. P., & Pantić, M. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2361018 · Cited by 23
Self-citationMulti-view Constrained Local Models for Large Head Angle Facial Tracking
Rajamanoharan, G., & Cootes, T. F. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.128 · Cited by 20
Fast Newton active appearance models
Kossaifi, J., Tzimiropoulos, G., & Pantić, M. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025284 · Cited by 10
Self-citationSnape, P., Roussos, A., Panagakis, Y., & Zafeiriou, S. P. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.343 · Cited by 9
Self-citation
Cited by
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Self-citationTowards Fast, Accurate and Stable 3D Dense Face Alignment
Guo, J., Zhu, X., Yang, Y., Yang, F., Lei, Z., & Li, S. Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58529-7_10 · Cited by 462
Facial Landmark Detection: A Literature Survey
Wu, Y., & Ji, Q. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1097-z · Cited by 404
Automatic Analysis of Facial Actions: A Survey
Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2731763 · Cited by 350
Self-citation
Metadata
- Authors
- Shen, J., Zafeiriou, S., Chrysos, G. G., Kossaifi, J., Tzimiropoulos, G., & Pantic, M.
- Venue
- 2015 IEEE International Conference on Computer Vision Workshop (ICCVW)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 1003-1011
- OpenAlex
- W2251810906
- Cited by
- 292
- References
- 60
- FWCI
- 13.58
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.