Human Facial Expression Recognition using a 3D Morphable Model
Abstract
We propose a novel approach to the detection and classification of human facial expressions using a morphable 3D model. We acquire the various expressions of an individual using a face scanner that produces textured 3D meshes using stereoscopic reconstruction. A morphable expression model (MEM), that incorporates emotion-dependent face variations in terms of morphing parameters, is then computed by establishing correspondence among the emotive faces. These morphing parameters are used for emotion recognition and classification. We demonstrate that the different facial expressions correspond to distinct clusters in the expression space.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,174 · see citing works
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695 · see citing works
Face recognition based on fitting a 3D morphable model
Blanz, V., & Vetter, T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227983 · Cited by 2,023 · see citing works
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1× · see citing works
“Image-based facial expression analysis [10] consists of 3 steps”
Method(1972) · Elsevier eBooks · doi:10.1016/c2013-0-02458-9 · Cited by 1,455 · see citing works
Face recognition: A literature survey
Arora, U. (2003) · ACM Computing Surveys · Cited by 794 · see citing works
Recognizing human facial expressions from long image sequences using optical flow
Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506414 · Cited by 458 · see citing works
Reanimating Faces in Images and Video
Blanz, V., Basso, C., Poggio, T., & Vetter, T. R. (2003) · Computer Graphics Forum · doi:10.1111/1467-8659.t01-1-00712 · Cited by 388 · see citing works
Ekman, P. 1.-2. (1982) · Cited by 237 · see citing works
Face recognition based on depth maps and surface curvature
Gordon, G. G. (1991) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.48428 · Cited by 221 · see citing works
A survey of approaches to three-dimensional face recognition
Bowyer, K. W., Chang, K., & Flynn, P. J. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1334126 · Cited by 110 · see citing works
Shelton, C. R. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008170818506 · Cited by 72 · see citing works
Automatic recognition of human facial expressions
Matsuno, K., Lee, C.-W., Kimura, S., et al. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466917 · Cited by 55 · see citing works
Manglik, P. K., Misra, U., ., P., & Maringanti, H. B. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1400658 · Cited by 19 · see citing works
Analysis and synthesis of six primary facial expressions using range images
Tatsuno, Y., Suzuki, S., Yokoya, N., et al. (1996) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1996.546995 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
Static and dynamic 3D facial expression recognition: A comprehensive survey
Sandbach, G., Zafeiriou, S., Pantic, M., & Yin, L. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.005 · Cited by 357 · see citing works
3D facial expression recognition using SIFT descriptors of automatically detected keypoints
Berretti, S., Ben Amor, B., Daoudi, M., & del Bimbo, A. (2011) · The Visual Computer · doi:10.1007/s00371-011-0611-x · Cited by 138 · see citing works
Zhao, X., Huang, D., Dellandrea, E., & Chen, L. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.907 · Cited by 66 · see citing works
Zhao, X., Dellandréa, E., Zou, J., & Chen, L. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.10.001 · Cited by 27 · see citing works
- Authors
- Ramanathan, S., Kassim, A., Venkatesh, Y. V., & Wah, W. S.
- Affiliations
- National University of Singapore (SG)
- Venue
- 2006 International Conference on Image Processing
- Publisher
- IEEE
- Published
- 2006-10
- Pages
- 661-664
- ISSN
- 1522-4880 (ISSN-L)
- OpenAlex
- W2023734821
- Cited by
- 62
- References
- 15
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2023: 1 · 2022: 2 · 2021: 5 · 2020: 4 · 2019: 5 · 2018: 6 · 2017: 4 · 2016: 1 · 2015: 4 · 2014: 4 · 2013: 3 · 2012: 6
- FWCI
- 1.13
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Image Processing (publishedVersion)
- National University of Singapore (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, 3D morphable model, emotion recognition, facial scanning, stereoscopic reconstruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
