A 3D Facial Expression Database For Facial Behavior Research
Abstract
Traditionally, human facial expressions have been studied using either 2D static images or 2D video sequences. The 2D-based analysis is incapable of handing large pose variations. Although 3D modeling techniques have been extensively used for 3D face recognition and 3D face animation, barely any research on 3D facial expression recognition using 3D range data has been reported. A primary factor for preventing such research is the lack of a publicly available 3D facial expression database. In this paper, we present a newly developed 3D facial expression database, which includes both prototypical 3D facial expression shapes and 2D facial textures of 2,500 models from 100 subjects. This is the first attempt at making a 3D facial expression database available for the research community, with the ultimate goal of fostering the research on affective computing and increasing the general understanding of facial behavior and the fine 3D structure inherent in human facial expressions. The new database can be a valuable resource for algorithm assessment, comparison and evaluation
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The most well known 3D datasets are BU-3DFE, Bosphorus, BU-4DFE and BP4D.
“The most well known 3D datasets are BU-3DFE [206], Bosphorus [195] (still images), BU-4DFE [207] (video) and BP4D [38] (video).”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [206]
In BU-3DFE, 6 expressions from 100 different subjects are captured on four different intensity levels.
“In BU-3DFE, 6 expression from 100 different subjects are captured on four different intensity levels.”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [206]
The publication of the BU-3DFE dataset was a starting point for consistently extending RGB FE recognition to 3D.
“The publication of the BU-3DFE dataset [206] was a starting point for consistently extending RGB FE recognition to 3D.”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [206]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1× · see citing works
“The excellent review of recent advances in this field can be found in [27, 42, 46, 28, 15].”
BackgroundRecognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745 · see citing works
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · see citing works
Measuring facial expressions by computer image analysis
Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · Psychophysiology · doi:10.1017/s0048577299971664 · Cited by 424 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression database
Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P., & Girard, J. M. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.06.002 · Cited by 745 · see citing works
Self-citationCorneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
Static and dynamic 3D facial expression recognition: A comprehensive survey
Sandbach, G., Zafeiriou, S., Pantic, M., & Yin, L. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.005 · Cited by 357 · see citing works
Self-citationMachine Analysis of Facial Expressions
Pantic, M., & Stewart, M. (2007) · Face Recognition · doi:10.5772/4847 · Cited by 248 · see citing works
Multimodal 2D+3D Facial Expression Recognition With Deep Fusion Convolutional Neural Network
Li, H., Sun, J., Xu, Z., & Chen, L. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2713408 · Cited by 211 · see citing works
Facial Expression Recognition: A Survey
Huang, Y., Chen, F., Lv, S., & Wang, X. (2019) · Symmetry · doi:10.3390/sym11101189 · Cited by 195 · see citing works
A survey of affect recognition methods: audio, visual and spontaneous expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2007) · Proceedings of the 9th international conference on Multimodal interfaces · doi:10.1145/1322192.1322216 · Cited by 144 · see citing works
3D facial expression recognition using SIFT descriptors of automatically detected keypoints
Berretti, S., Ben Amor, B., Daoudi, M., & del Bimbo, A. (2011) · The Visual Computer · doi:10.1007/s00371-011-0611-x · Cited by 138 · see citing works
3D facial expression recognition based on automatically selected features
Tang, H., & Huang, T. S. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563052 · Cited by 140 · see citing works
3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model
Nair, P., & Cavallaro, A. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2017629 · Cited by 135 · see citing works
Towards macro- and micro-expression spotting in video using strain patterns
Shreve, M., Godavarthy, S., Manohar, V., Goldgof, D., & Sarkar, S. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403044 · Cited by 124 · see citing works
Automatic facial expression recognition on a single 3D face by exploring shape deformation
Gong, B., Wang, Y., Liu, J., & Tang, X. (2009) · Proceedings of the 17th ACM international conference on Multimedia · doi:10.1145/1631272.1631358 · Cited by 116 · see citing works
Zhao, X., Huang, D., Dellandrea, E., & Chen, L. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.907 · Cited by 66 · see citing works
Zhao, X., Dellandréa, E., Zou, J., & Chen, L. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.10.001 · Cited by 27 · see citing works
Dynamic facial expression recognition by joint static and multi-time gap transition classification
Dapogny, A., Bailly, K., & Dubuisson, S. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163111 · Cited by 24 · see citing works
- Authors
- Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J.
- Affiliations
- Binghamton University (US)
- Venue
- 7th International Conference on Automatic Face and Gesture Recognition (FGR06)
- Publisher
- IEEE
- Published
- 2006-04-28
- Pages
- 211-216
- ISSN
- 1541-5058 (ISSN-L)
- OpenAlex
- W2137306662
- Cited by
- 1,171
- References
- 4
- Citations by year
- 2026: 19 · 2025: 25 · 2024: 49 · 2023: 49 · 2022: 52 · 2021: 102 · 2020: 86 · 2019: 105 · 2018: 89 · 2017: 64 · 2016: 68 · 2015: 71 · 2014: 66 · 2013: 73 · 2012: 57
- FWCI
- 25.77
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automatic Face and Gesture Recognition (publishedVersion)
- Funders
- National Science Foundation (0414029, 0541044)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- facial expression recognition, 3D range data, facial behavior, affective computing, 3D face models, facial texture, pose variation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review