The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
OpenFace: An open source facial behavior analysis toolkit
Open accessAbstract
Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace - an open source tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first open source tool capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware. Finally, OpenFace allows for easy integration with other applications and devices through a lightweight messaging system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
Gaze and eye contact: a research review
Kleinke, C. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.100.1.78 · Cited by 1,455
Facial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,365
Head Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Interactive Facial Feature Localization
Le, V., Brandt, J., Lin, Z., Bourdev, L., & Huang, T. S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_49 · Cited by 920
DISFA: A Spontaneous Facial Action Intensity Database
Mavadati, S. M., Mahoor, M. H., Bartlett, K., Trinh, P., & Cohn, J. F. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.4 · Cited by 793
Deformable Model Fitting by Regularized Landmark Mean-Shift
Saragih, J. M., Lucey, S., & Cohn, J. F. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0380-4 · Cited by 787
Robust Face Landmark Estimation under Occlusion
Burgos-Artizzu, X. P., Perona, P., & Dollar, P. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.191 · Cited by 775
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression database
Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P., & Girard, J. M. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.06.002 · Cited by 745
Feature Detection and Tracking with Constrained Local Models
Cristinacce, D., & Cootes, T. F. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.95 · Cited by 718
Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
The spontaneous expression of pride and shame: Evidence for biologically innate nonverbal displays
Tracy, J. L., & Matsumoto, D. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802686105 · Cited by 637
Bartlett, M. S., Littlewort, G., Fasel, I., & Movellan, J. R. (2003) · 2003 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvprw.2003.10057 · Cited by 573
La Cascia, M., Sclaroff, S., & Athitsos, V. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.845375 · Cited by 566
Robust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Localizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Incremental Face Alignment in the Wild
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.240 · Cited by 450
Real time head pose estimation with random regression forests
Fanelli, G., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995458 · Cited by 436
Appearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.54 · Cited by 415
Self-citationCross-dataset learning and person-specific normalisation for automatic Action Unit detection
Baltrusaitis, T., Mahmoud, M., & Robinson, P. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284869 · Cited by 412
Self-citationAnnotating Multi-media/Multi-modal Resources with ELAN
Brugman, H., & Russel, A. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4orb5nuwpvji · Cited by 408
The first facial expression recognition and analysis challenge
Valstar, M. F., Jiang, B., Mehu, M., Pantic, M., & Scherer, K. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771374 · Cited by 385
3D Constrained Local Model for rigid and non-rigid facial tracking
Baltrusaitis, T., Robinson, P., & Morency, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247980 · Cited by 313
Self-citationRendering of Eyes for Eye-Shape Registration and Gaze Estimation
Wood, E., Baltruaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.428 · Cited by 308
Self-citationReal Time Head Pose Estimation from Consumer Depth Cameras
Fanelli, G., Weise, T., Gall, J., & Van Gool, L. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23123-0_11 · Cited by 303
The SEMAINE corpus of emotionally coloured character interactions
McKeown, G., Valstar, M. F., Cowie, R., & Pantic, M. (2010) · 2010 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2010.5583006 · Cited by 278
AVEC 2011–The First International Audio/Visual Emotion Challenge
Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., & Pantic, M. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24571-8_53 · Cited by 271
Robust real-time pupil tracking in highly off-axis images
Świrski, L., Bulling, A., & Dodgson, N. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168585 · Cited by 270
Relative importance of face, body, and speech in judgments of personality and affect.
Ekman, P., Friesen, W. V., O’Sullivan, M., & Scherer, K. R. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.38.2.270 · Cited by 268
FERA 2015 - second Facial Expression Recognition and Analysis challenge
Valstar, M. F., Almaev, T., Girard, J. M., McKeown, G., Mehu, M., Yin, L., Pantic, M., & Cohn, J. F. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284874 · Cited by 252
Facial feature point detection: A comprehensive survey
Wang, N., Gao, X., Tao, D., Yang, H., & Li, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.05.013 · Cited by 238
Action unit detection using sparse appearance descriptors in space-time video volumes
Jiang, B., Valstar, M. F., & Pantic, M. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771416 · Cited by 233
Project-Out Cascaded Regression with an application to face alignment
Tzimiropoulos, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298989 · Cited by 218
EyeTab: model-based gaze estimation on unmodified tablet computers
Wood, E., & Bulling, A. (2014) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2578153.2578185 · Cited by 215
Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild
Tzimiropoulos, G., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.239 · Cited by 215
Max-Margin Object DetectionPreprint
King, D. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.00046 · Cited by 207
Social risk and depression: Evidence from manual and automatic facial expression analysis
Girard, J. M., Cohn, J. F., Mahoor, M. H., Mavadati, S., & Rosenwald, D. P. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553748 · Cited by 191
de la Torre, F. N., & Cohn, J. F. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_19 · Cited by 188
Deep learning based FACS Action Unit occurrence and intensity estimation
Gudi, A., Tasli, H. E., den Uyl, T. M., & Maroulis, A. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284873 · Cited by 175
Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition
Martínez, B., & Valstar, M. (2016) · Springer eBooks · doi:10.1007/978-3-319-25958-1_4 · Cited by 150
Facial Features for Affective State Detection in Learning Environments
McDaniel, B., D’Mello, S. K., King, B. G., Chipman, P., Tapp, K. M., & Graesser, A. C. (2007) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 132
Local Evidence Aggregation for Regression-Based Facial Point Detection
Martínez, B., Valstar, M., Binefa, X., & Pantić, M. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.205 · Cited by 127
Detection of Emotions during Learning with AutoTutor
Chipman, P., D’Mello, S. K., Gholson, B., Graesser, A. C., McDaniel, B., & Witherspoon, A. M. (2006) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 120
Dimensional affect recognition using Continuous Conditional Random Fields
Baltrušaitis, T., Banda, N., & Robinson, P. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553785 · Cited by 110
Self-citationMorency, L., Whitehill, J., & Movellan, J. R. (2008) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2008.4813429 · Cited by 99
Self-citationTowards Personalised Gaming via Facial Expression Recognition
Blom, P. M., Bakkes, S. C. J., Tan, C. T., Whiteson, S., Roijers, D. M., Valenti, R., & Gevers, T. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12707 · Cited by 81
Automatic Nonverbal Behavior Indicators of Depression and PTSD: Exploring Gender Differences
Stratou, G., Scherer, S. J., Gratch, J. S., & Morency, L. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.31 · Cited by 78
Self-citationPredicting online media effectiveness based on smile responses gathered over the Internet
McDuff, D., el Kaliouby, R., Demirdjian, D., & Picard, R. W. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553750 · Cited by 72
Sieving Regression Forest Votes for Facial Feature Detection in the Wild
Yang, H., & Patras, I. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.243 · Cited by 72
Computation of emotions in man and machines
Robinson, P., & el Kaliouby, R. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0198 · Cited by 59
Self-citationNatural affect data — Collection & annotation in a learning context
Afzal, S., & Robinson, P. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349537 · Cited by 48
Self-citationDecoupling facial expressions and head motions in complex emotions
Adams, A., Mahmoud, M., Baltrušaitis, T., & Robinson, P. (2015) · International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii.2015.7344583 · Cited by 45
Self-citationHigh Accuracy Head Pose Tracking Survey
Czupryński, B., & Strupczewski, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-09912-5_34 · Cited by 35
A cheap portable eye-tracker solution for common setups
Ferhat, O., Vilariño, F., & Sánchez, F. J. (2014) · Journal of Eye Movement Research · doi:10.16910/jemr.7.3.2 · Cited by 33
Advances in Multimodal Tracking of Driver Distraction
Busso, C., & Jain, J. J. (2011) · Springer eBooks · doi:10.1007/978-1-4419-9607-7_18 · Cited by 19
Head mounted device for point-of-gaze estimation in three dimensions
Lidegaard, M., Hansen, D. W., & Krüger, N. (2014) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/2578153.2578163 · Cited by 17
What can head and facial movements convey about positive and negative affect?
Hammal, Z., Cohn, J. F., Heike, C. L., & Speltz, M. L. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344584 · Cited by 17
Research works printed but not linked: 3
- 10.1037/0022-3514.38.2.270 · doi:10.1037/0022-3514.38.2.270 · Paper page
- thomas, 2015, Measuring head posture in 3 dimensions with the Cambridge Face Tracker: accurate, inexpensive, easy to use, World Congress of Pediatric Ophthalmology and Strabismus
- ekman, 1977, Manual for the Facial Action Coding System
Cited by
Tensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102
Self-citationOpenface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Self-citationMultimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433
Self-citationMISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Hazarika, D., Zimmermann, R., & Poria, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413678 · Cited by 1,073
“For UR_FUNNY, OpenFace [4], a facial behavioral analysis tool, is used to extract features related to the facial expressions of the speaker.”
MethodPan, X., & Hamilton, A. F. D. C. (2018) · British Journal of Psychology · doi:10.1111/bjop.12290 · Cited by 729
Metadata
- Authors
- Baltrusaitis, T., Robinson, P., & Morency, L.-P.
- Venue
- 2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 1-10
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W2395639500
- Cited by
- 1,747
- References
- 69
- FWCI
- 62.26
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.