The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
FERA 2015 - second Facial Expression Recognition and Analysis challenge
Abstract
Despite efforts towards evaluation standards in facial expression analysis (e.g. FERA 2011), there is a need for up-to-date standardised evaluation procedures, focusing in particular on current challenges in the field. One of the challenges that is actively being addressed is the automatic estimation of expression intensities. To continue to provide a standardisation platform and to help the field progress beyond its current limitations, the FG 2015 Facial Expression Recognition and Analysis challenge (FERA 2015) will challenge participants to estimate FACS Action Unit (AU) intensity as well as AU occurrence on a common benchmark dataset with reliable manual annotations. Evaluation will be done using a clear and well-defined protocol. In this paper we present the second such challenge in automatic recognition of facial expressions, to be held in conjunction with the 11 IEEE conference on Face and Gesture Recognition, May 2015, in Ljubljana, Slovenia. Three sub-challenges are defined: the detection of AU occurrence, the estimation of AU intensity for pre-segmented data, and fully automatic AU intensity estimation. In this work we outline the evaluation protocol, the data used, and the results of a baseline method for the three sub-challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a consequence the Facial Expression and Recognition (FERA) challenge added a special section for intensity estimation [231], [232].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [232]
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & la Torre, F. D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.75 · Cited by 1,926
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Zhang, W., Shan, S., Gao, W., Chen, X., & Zhang, H. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.147 · Cited by 1,037
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression database
Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P., & Girard, J. M. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.06.002 · Cited by 745
Self-citationMcKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schroder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.20 · Cited by 665
Self-citation(2017) · The SAGE Encyclopedia of Communication Research Methods · doi:10.4135/9781483381411.n178 · Cited by 559
Flagged first, then by citations
1 of the 25 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- mckeown, 2015, The underdetermined nature of laughter: the blurring of boundaries in social signals, unknown
- wu, 2012, Multi-layer architectures of facial action unit recognition, IEEE Trans Systems Man and Cybernetics Part B
Cited by
Sorted by citations
Items 201–250 of 250
Facial Action Unit Detection using 3D Facial LandmarksPreprint
Hinduja, S., & Canavan, S. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08343 · Cited by 3
Exploiting an Oracle That Reports AUC Scores in Machine Learning Contests
Whitehill, J. (2016) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v30i1.10138 · Cited by 2
Real-Time Stress Detection Using Webcam-Based Physiological Signals and Interpretable ML
Elawady, I., & Kavsaoğlu, A. R. (2025) · International Symposium on Innovative Approaches in Smart Technologies (ISAS) · doi:10.1109/isas66241.2025.11101927 · Cited by 2
Kalliatakis, G., Vidakis, N., & Triantafyllidis, G. A. (2016) · Computer Science and Electronic Engineering Conference · doi:10.1109/ceec.2016.7835887 · Cited by 2
Framework for an embedded emotion assessment system for space science applications
Bălțoiu, A., Petrică, L., Dinculescu, A. C., & Vizitiu, C. (2017) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb.2017.7995363 · Cited by 2
Dupré, D., Andelic, N., Morrison, G., & McKeown, G. J. (2018) · Electronic workshops in computing · doi:10.14236/ewic/hci2018.1 · Cited by 2
Self-citationDynamic Facial Feature Learning by Deep Evolutionary Neural Networks
Zhi, R., Zhou, C., & Li, T. (2019) · Communications in computer and information science · doi:10.1007/978-981-15-1925-3_23 · Cited by 2
Chen, Y., Zhang, J., Wang, T., & Liang, Y. E. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i1.27803 · Cited by 2
Facial Action Unit Detection Based on Transformer and Attention Mechanism
Song, W., Shi, S., & An, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87358-5_37 · Cited by 2
Types of Nonverbal Communication [Working Title]
Jiang, X. (2020) · IntechOpen eBooks · doi:10.5772/intechopen.83004 · Cited by 2
Weakly Supervised Learning for Facial Behavior Analysis: A ReviewPreprint
Praveen, R. G., Cardinal, P., & Granger, É. (2024) · doi:10.36227/techrxiv.173091765.50249538/v1 · Cited by 2
A primer on observational measurementPreprint
Girard, J. M., & Cohn, J. F. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/582cy · Cited by 3
Self-citationBiosignal recognition for patients identification
Hussain, H., Ibrahim, M. N., Ting, C., Noman, F. M., Hamedi, M., Sh-Hussain, H., & Ninggal, M. T. (2016) · IEEE-EMBS Conference on Biomedical Engineering and Sciences · doi:10.1109/iecbes.2016.7843420 · Cited by 1
A review study of human-affection knowledge on usability engineering
Lakshmi, D., & Ponnusamy, R. (2016) · International Conference on Advances in Human Machine Interaction (HMI) · doi:10.1109/hmi.2016.7449174 · Cited by 1
MRP-Net: A Light Multiple Region Perception Neural Network for Multi-label AU Detection
Tang, Y. S., Chen, S., Zhang, H., Wang, G., & Yang, R. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412515 · Cited by 1
Dual‐attention guided network for facial action unit detection
Song, W., Shi, S., Wu, Y., & An, G. (2022) · IET Image Processing · doi:10.1049/ipr2.12480 · Cited by 1
Supervised dimensionality reduction for multi-dimensional classification
Jia, B.-B., & ZHANG, M. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2022-0363 · Cited by 1
MTFNet: Multi-Scale Transformer Framework for Robust Emotion Monitoring in Group Learning Settings
Zhang, Y., Liu, F., Song, J., Zeng, Q., & He, H. X. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848828 · Cited by 1
Facial expression pair matching
Engin, D., Ekenel, H. K., & Bölümü, B. M. (2017) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2017.7960646 · Cited by 1
The 3D Emotion Recognition Using SVM and HoG Features
Savakar, D. G., & Hosur, R. (2020) · International Journal of Image and Graphics · doi:10.1142/s0219467820500199 · Cited by 1
Retracted: Survey on Automatic Temperature and Face Detection using AI
Muthu, V., & Kavitha, S. N. (2021) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac52330.2021.9640662 · Cited by 1
RetractedA Comprehensive Investigation on Emotional Detection in Deep Learning
Anand, M., & Babu, S. (2022) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit228111 · Cited by 2
Unsupervised Facial Action Unit Intensity Estimation via Differentiable OptimizationPreprint
Song, X., Shi, T., Shao, T., Yuan, Y., Feng, Z., & Fan, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05908 · Cited by 1
Impact of Action Unit Occurrence Patterns on DetectionPreprint
Hinduja, S., Canavan, S. J., & Aathreya, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07982 · Cited by 1
Chen, J., Wang, C., Wang, K., & Liu, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12082 · Cited by 1
Intensity Estimation of the Real-World Facial Expression
Gao, Y., Li, S., & Deng, W. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-3002-4_7
Znamenskaya, I. A., Koroteeva, E. Y., Shishakov, V. V., Khakhalin, A. V., Кузьмичева, Е. А., Исайчев, С. А., & Chernorizov, A. M. (2017) · Scientific Visualization · doi:10.26583/sv.9.4.04
Literature Survey and Datasets
Poria, S., Hussain, A., & Cambria, E. (2018) · Socio-affective computing · doi:10.1007/978-3-319-95020-4_3
Nonverbal Communication through Facial Expression in Diverse Conditions
Goyani, M. M. (2021) · IntechOpen eBooks · doi:10.5772/intechopen.95109
Zhang, J. (2021) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/icces51350.2021.9489189
Zhang, B. (2018) · Deep Blue (University of Michigan)
Bishay, M., Ghoneim, A., Ashraf, M., & Mavadati, M. (2021) · arXiv (Cornell University) · doi:10.17023/6sn6-x651
Yin, Y. (2018) · doi:10.17760/d20316370
Audiovisual Facial Action Unit Recognition Using Feature Level Fusion
Meng, Z., Han, S., Chen, M., & Tong, Y. (2018) · IGI Global eBooks · doi:10.4018/978-1-5225-5204-8.ch024
Deception Detection System with Joint Cross-Attention
Jiang, P., Wang, Z., Li, J., & Wang, Y. (2024) · International Symposium on Signal Processing Systems (SSPS) · doi:10.1145/3665053.3665056
Review on Facial Emotion Recognition Using Deep Learning With Multiple Databases
Prasad, M. H., Swarnalatha, P., Anantharajah, K., & Prabu, S. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-3719-6.ch018
A Proposal for Deep Learning Based Emotion Identification
Nayak, S., Pandey, M., & Rautaray, S. S. (2024) · International Conference on System Modeling & Advancement in Research Trends (SMART) · doi:10.1109/smart63812.2024.10882469
Tiuleneva, M., Castano, E., & Niewiadomski, R. (2024) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii63134.2024.00016
Feng, S., Ma, J., & de Sa, V. R. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099285
Weakly Supervised Learning for Facial Affective Behavior Analysis: A Review
Praveen, R. G., Cardinal, P., & Granger, É. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3677128 · Cited by 4
Reading Faces. Using Hard Multi-Task Metric Learning for Kernel Regression
Nicolle, J. (2016) · theses.fr (ABES) · doi:10.70675/8a22a6caz95d0z4cb8zaeadz043ba01a754d
Construction non supervisée d'un modèle expressif spécifique à la personne
Weber, R. (2017) · theses.fr (ABES) · doi:10.70675/2f458edfz3d99z43cezb849zdf8729c5aad0
Apprentissage neuronal profond pour l'analyse de contenus multimodaux et temporels
Vielzeuf, V. (2019) · theses.fr (ABES) · doi:10.70675/cd4ec871zb372z492fz94bfz25086c5fda4a
Cornec, K. L. (2020) · theses.fr (ABES) · doi:10.70675/208af321z8d3bz4b62z99f6z0b296efd57bc
Deep learning for automatic facial expression assessment with application to the expression of pain
Vu, M. T. (2022) · theses.fr (ABES) · doi:10.70675/b3a4930cz2ae5z4f53z9602ze781cb8f524a
Enhancing facial action unit intensity estimation with ordinal regression-enhanced transformer
Xu, R., Su, S., Xie, C., & Chen, J. (2026) · The Visual Computer · doi:10.1007/s00371-026-04557-0
Expert Knowledge-Informed Heatmap Generation for Action Unit Intensity Regression
Ji, Y., Xu, R., Ma, P., Zheng, Y., Min, Y., Yang, Z., & Chen, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38401-0_24
Capturing Dynamics: The 4D Facial Expression Intensity Dataset
zesheng, W., Bruckert, A., Lebreton, P., Callet, P. L., Li, Y., & Zhao, G. (2026) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr70517.2026.00076
A Deep Learning Perspective on the Origin of Facial Expressions
Breuer, R., & Kimmel, R. (2017) · arXiv · doi:10.48550/arxiv.1705.01842 · Cited by 92
Metadata
- Authors
- Valstar, M. F., Almaev, T., Girard, J. M., McKeown, G., Mehu, M., Yin, L., Pantic, M., & Cohn, J. F.
- Affiliations
- University of Nottingham (GB)
- University of Pittsburgh (US)
- Queen's University Belfast (GB)
- Binghamton University (US)
- Venue
- 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
- Publisher
- IEEE
- Published
- 2015-05
- Pages
- 1-8
- ISSN
- 1541-5058 (ISSN-L)
- OpenAlex
- W1655469623
- Cited by
- 252
- References
- 25
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 12 · 2023: 7 · 2022: 11 · 2021: 31 · 2020: 17 · 2019: 39 · 2018: 32 · 2017: 41 · 2016: 33 · 2015: 19
- FWCI
- 55.51
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automatic Face and Gesture Recognition (publishedVersion)
- Research Portal (Queen's University Belfast) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, facial expression analysis, action unit detection, benchmark dataset, evaluation protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review