The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Cross-dataset learning and person-specific normalisation for automatic Action Unit detection
Abstract
Automatic detection of Facial Action Units (AUs) is crucial for facial analysis systems. Due to the large individual differences, performance of AU classifiers depends largely on training data and the ability to estimate facial expressions of a neutral face. In this paper, we present a real-time Facial Action Unit intensity estimation and occurrence detection system based on appearance (Histograms of Oriented Gradients) and geometry features (shape parameters and landmark locations). Our experiments show the benefits of using additional labelled data from different datasets, which demonstrates the generalisability of our approach. This holds both when training for a specific dataset or when a generic model is needed. We also demonstrate the benefits of using a simple and efficient median based feature normalisation technique that accounts for person-specific neutral expressions. Finally, we show that our results outperform the FERA 2015 baselines in all three challenge tasks - AU occurrence detection, fully automatic AU intensity and pre-segmented AU intensity estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
DISFA: A Spontaneous Facial Action Intensity Database
Mavadati, S. M., Mahoor, M. H., Bartlett, K., Trinh, P., & Cohn, J. F. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.4 · Cited by 793
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression database
Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P., & Girard, J. M. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.06.002 · Cited by 745
Feature Detection and Tracking with Constrained Local Models
Cristinacce, D., & Cootes, T. F. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.95 · Cited by 718
Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
Bartlett, M. S., Littlewort, G., Fasel, I., & Movellan, J. R. (2003) · 2003 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvprw.2003.10057 · Cited by 573
Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.54 · Cited by 415
Self-citationThe first facial expression recognition and analysis challenge
Valstar, M. F., Jiang, B., Mehu, M., Pantic, M., & Scherer, K. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771374 · Cited by 385 · cited 2×
“We refer the reader to recent surveys and challenges [6], [22], [23], [25].”
MethodLIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Selective Transfer Machine for Personalized Facial Action Unit Detection
Chu, W.-S., De la Torre, F., & Cohn, J. F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.451 · Cited by 307
The SEMAINE corpus of emotionally coloured character interactions
McKeown, G., Valstar, M. F., Cowie, R., & Pantic, M. (2010) · 2010 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2010.5583006 · Cited by 278
AVEC 2011–The First International Audio/Visual Emotion Challenge
Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., & Pantic, M. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24571-8_53 · Cited by 271
(2009) · Encyclopedia of Biometrics · doi:10.1007/978-0-387-73003-5_2171 · Cited by 265
FERA 2015 - second Facial Expression Recognition and Analysis challenge
Valstar, M. F., Almaev, T., Girard, J. M., McKeown, G., Mehu, M., Yin, L., Pantic, M., & Cohn, J. F. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284874 · Cited by 252
Social risk and depression: Evidence from manual and automatic facial expression analysis
Girard, J. M., Cohn, J. F., Mahoor, M. H., Mavadati, S., & Rosenwald, D. P. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553748 · Cited by 191
de la Torre, F. N., & Cohn, J. F. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_19 · Cited by 188
Continuous AU intensity estimation using localized, sparse facial feature space
Jeni, L. A., Girard, J. M., Cohn, J. F., & De La Torre, F. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553808 · Cited by 93
Emotion perception in emotionless face images suggests a norm-based representation
Neth, D., & Martínez, A. M. (2009) · Journal of Vision · doi:10.1167/9.1.5 · Cited by 79
Computation of emotions in man and machines
Robinson, P., & el Kaliouby, R. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0198 · Cited by 75
Self-citationPredicting online media effectiveness based on smile responses gathered over the Internet
McDuff, D., el Kaliouby, R., Demirdjian, D., & Picard, R. W. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553750 · Cited by 72
Data-Free Prior Model for Facial Action Unit Recognition
Li, Y., Chen, J., Zhao, Y.-P., & Ji, Q. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.5 · Cited by 67
Natural affect data — Collection & annotation in a learning context
Afzal, S., & Robinson, P. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349537 · Cited by 48
Self-citationAction unit recognition transfer across datasets
Wu, T., Butko, N. J., Ruvolo, P., Whitehill, J., Bartlett, M. S., & Movellan, J. R. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771369 · Cited by 29
Research works printed but not linked: 1
- ekman, 1977, Manual for the Facial Action Coding System
Cited by
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Self-citationOpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Self-citationGANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621
(2019) · Cited by 415
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Guo, Y., Chen, K., Liang, S., Liu, Y.-J., Bao, H., & Zhang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00573 · Cited by 384
Metadata
- Authors
- Baltrusaitis, T., Mahmoud, M., & Robinson, P.
- Venue
- 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
- Publisher
- IEEE
- Published
- 2015-05
- Pages
- 1-6
- OpenAlex
- W1628791547
- Cited by
- 412
- References
- 27
- FWCI
- 12.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.