The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
OpenFace: An open source facial behavior analysis toolkit
Open accessAbstract
Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace - an open source tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first open source tool capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware. Finally, OpenFace allows for easy integration with other applications and devices through a lightweight messaging system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Gross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
Gaze and eye contact: a research review
Kleinke, C. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.100.1.78 · Cited by 1,455
Research works printed but not linked: 3
- 10.1037/0022-3514.38.2.270 · doi:10.1037/0022-3514.38.2.270 · Paper page
- thomas, 2015, Measuring head posture in 3 dimensions with the Cambridge Face Tracker: accurate, inexpensive, easy to use, World Congress of Pediatric Ophthalmology and Strabismus
- ekman, 1977, Manual for the Facial Action Coding System
Cited by
Tensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102
Self-citationOpenface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Self-citationMultimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433
Self-citationMISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Hazarika, D., Zimmermann, R., & Poria, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413678 · Cited by 1,073
“For UR_FUNNY, OpenFace [4], a facial behavioral analysis tool, is used to extract features related to the facial expressions of the speaker.”
MethodPan, X., & Hamilton, A. F. D. C. (2018) · British Journal of Psychology · doi:10.1111/bjop.12290 · Cited by 729
Deep Multimodal Representation Learning: A Survey
Guo, W., Wang, J., & Wang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2916887 · Cited by 535
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988258 · Cited by 503
(2019) · Cited by 415
Automatic Analysis of Facial Actions: A Survey
Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2731763 · Cited by 350
LightFace: A Hybrid Deep Face Recognition Framework
Serengil, S. I., & Ozpinar, A. (2020) · 2020 Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu50717.2020.9259802 · Cited by 347
AVEC 2017: Real-life Depression, and Affect Recognition Workshop and Challenge
Ringeval, F., Schuller, B., Valstar, M., Gratch, J., Cowie, R., Scherer, S., Mozgai, S., Cummins, N., Schmitt, M., & Pantic, M. (2017) · Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge · doi:10.1145/3133944.3133953 · Cited by 332
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A., & Cambria, E. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 329
Personalized machine learning for robot perception of affect and engagement in autism therapy
Rudovic, O., Lee, J., Dai, M., Schuller, B., & Picard, R. W. (2018) · Science Robotics · doi:10.1126/scirobotics.aao6760 · Cited by 316
Facial expression analysis with AFFDEX and FACET: A validation study
Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., & Samson, A. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0996-1 · Cited by 294
Tang, H., Liu, H., Xu, D., Torr, P. H. S., & Sebe, N. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105725 · Cited by 288
Goldberg, P., Sümer, Ö., Stürmer, K., Wagner, W., Göllner, R., Gerjets, P., Kasneci, E., & Trautwein, U. (2021) · Educational Psychology Review · doi:10.1007/s10648-019-09514-z · Cited by 280
Cingulate dynamics track depression recovery with deep brain stimulation
Alagapan, S., Choi, K. S., Heisig, S., Riva-Posse, P., Crowell, A., Tiruvadi, V., Obatusin, M., Veerakumar, A., Waters, A. C., Gross, R. E., et al. (2023) · Nature · doi:10.1038/s41586-023-06541-3 · Cited by 274
Deep learning for depression recognition with audiovisual cues: A review
He, L., Niu, M., Tiwari, P., Marttinen, P., Su, R., Jiang, J., Guo, C., Wang, H., Ding, S., Wang, Z., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.10.012 · Cited by 253
Decoupled Multimodal Distilling for Emotion Recognition
Li, Y., Wang, Y., & Cui, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00641 · Cited by 249
Detecting Deep-Fake Videos from Appearance and Behavior
Agarwal, S., Farid, H., El-Gaaly, T., & Lim, S.-N. (2020) · 2020 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs49906.2020.9360904 · Cited by 242
“Faces for this facial biometric and the behavioral biometric are extracted using OpenFace [26].”
MethodDetecting Deep-Fake Videos from Phoneme-Viseme Mismatches
Agarwal, S., Farid, H., Fried, O., & Agrawala, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00338 · Cited by 234
Highly automated job interviews: Acceptance under the influence of stakes
Langer, M., König, C. J., & Papathanasiou, M. (2019) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12246 · Cited by 203
A general framework for adversarial examples with objectives
Sharif, M., Bhagavatula, S., Bauer, L., & Reiter, M. K. (2019) · ACM Transactions on Privacy and Security · doi:10.1145/3317611 · Cited by 200
UR-FUNNY: A Multimodal Language Dataset for Understanding Humor
Hasan, M. K., Rahman, W., Bagher Zadeh, A., Zhong, J., Tanveer, M. I., Morency, L.-P., & Hoque, M. (. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1211 · Cited by 174
“Visual: OpenFace facial behavioral analysis tool (Baltruˇsaitis et al., 2016) is used to extract the facial expression features at the rate of 30 frame/sec.”
BackgroundMethodInfluentialSelf-citationFAMM: Facial Muscle Motions for Detecting Compressed Deepfake Videos Over Social Networks
Liao, X., Wang, Y., Wang, T., Hu, J., & Wu, X. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3278310 · Cited by 169
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
Mangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12590 · Cited by 100
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Liang, P. P., Lyu, Y., Fan, X., Wu, Z., Cheng, Y., Wu, J., Chen, L., Wu, P., Lee, M. A., Zhu, Y., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.07502 · Cited by 85
Self-citationLiang, T., Lin, G., Feng, L., Zhang, Y., & Lv, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00804 · Cited by 93
Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies
Hosler, B., Salvi, D., Murray, A., Antonacci, F., Bestagini, P., Tubaro, S., & Stamm, M. C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00112 · Cited by 78
Cloud Versus Edge Deployment Strategies of Real-Time Face Recognition Inference
Koubaa, A., Ammar, A., Kanhouch, A., & AlHabashi, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3055835 · Cited by 69
DeepFake on Face and Expression Swap: A Review
Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65
Abbas, A., Sauder, C., Yadav, V., Koesmahargyo, V., Aghjayan, A., Marecki, S., Evans, M., & Galatzer-Levy, I. R. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.610006 · Cited by 49
Zheng, W., Yu, J., Xia, R., & Wang, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.861 · Cited by 51
“4https://ffmpeg.org/ 5https://github.com/TadasBaltrusaitis/OpenFace A.2 Pseudo-code of MARIO We provide the pseudocode for training the proposed MARIO model, where θSwin, θT , θself−attn, and θCMT represent the parameters of SwinTransformer, the text encoder, self-attention Transformer, and Cross-Modal Transformer, re…”
BackgroundMethodInfluentialMultimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks
Huang, J., Li, Y., Tao, J., Lian, Z., Niu, M., & Yang, M. (2018) · Proceedings of the 2018 on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3266302.3266304 · Cited by 40
Towards Understanding and Detecting Cyberbullying in Real-world Images
Vishwamitra, N., Hu, H., Luo, F., & Cheng, L. (2021) · Proceedings 2021 Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24260 · Cited by 39
Emergence of deepfakes and video tampering detection approaches: A survey
Kingra, S., Aggarwal, N., & Kaur, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13100-x · Cited by 33
Wangwiwattana, C., Ding, X., & Larson, E. C. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161164 · Cited by 26
Galatzer-Levy, I., Abbas, A., Ries, A., Homan, S., Sels, L., Koesmahargyo, V., Yadav, V., Colla, M., Scheerer, H., Vetter, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25199 · Cited by 23
The fundamentals of eye tracking part 6: working with areas of interest
Hooge, I. T. C., Nyström, M., Niehorster, D. C., Andersson, R., Foulsham, T., Nuthmann, A., & Hessels, R. S. (2026) · Behavior Research Methods · doi:10.3758/s13428-025-02937-3 · Cited by 22
“For each frame of the movie featuring the actress, we use OpenFace (Baltrušaitis et al., 2016) to determine the centers of the eyes, nose, and mouth.”
InfluentialChojecki, P., Strazdas, D., Przewozny, D., Gard, N., Runde, D., Hoerner, N., Al-Hamadi, A., Eisert, P., & Bosse, S. (2023) · doi:10.20944/preprints202304.0415.v2 · Cited by 7
(2023) · doi:10.3390/s23115043 · Cited by 7
AI-enabled Parkinson's disease screening using smile videos
Adnan, T., Islam, M. S., Lee, S., Wasifur Rahman Chowdhury, E. M., Tithi, S. D., Noshin, K., Islam, M. R., Sarker, I., Rahman, M. S., Schneider, R. B., et al. (2025) · NEJM AI · doi:10.1056/aioa2400950 · Cited by 5
Multimodal Observation and Interpretation of Subjects Engaged in Problem Solving
Guntz, T., Balzarini, R., Vaufreydaz, D., & Crowley, J. L. (2017) · arXiv · doi:10.48550/arxiv.1710.04486 · Cited by 4
Relating Children’s Automatically Detected Facial Expressions to Their Behavior in RoboTutor
Saxena, M., Pillai, R., & Mostow, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12190 · Cited by 2
Metadata
- Authors
- Baltrusaitis, T., Robinson, P., & Morency, L.-P.
- Venue
- 2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 1-10
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W2395639500
- Cited by
- 1,747
- References
- 69
- FWCI
- 62.26
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.