The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Face recognition based on fitting a 3D morphable model
Abstract
This paper presents a method for face recognition across variations in pose, ranging from frontal to profile views, and across a wide range of illuminations, including cast shadows and specular reflections. To account for these variations, the algorithm simulates the process of image formation in 3D space, using computer graphics, and it estimates 3D shape and texture of faces from single images. The estimate is achieved by fitting a statistical, morphable model of 3D faces to images. The model is learned from a set of textured 3D scans of heads. We describe the construction of the morphable model, an algorithm to fit the model to images, and a framework for face identification. In this framework, faces are represented by model parameters for 3D shape and texture. We present results obtained with 4,488 images from the publicly available CMU-PIE database and 1,940 images from the FERET database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
(1981) · Cited by 11,963
Horn, B. K. P., & Schunck, B. G. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90024-2 · Cited by 10,312
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Horn, B. K., & Schunck, B. G. (1981) · SPIE Proceedings · doi:10.1117/12.965761 · Cited by 7,394
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Self-citation
Cited by
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction
Choy, C. B., Xu, D., Gwak, J., Chen, K., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_38 · Cited by 1,632
A 3D Face Model for Pose and Illumination Invariant Face Recognition
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., & Vetter, T. (2009) · 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance · doi:10.1109/avss.2009.58 · Cited by 1,326
Self-citationFace Alignment Across Large Poses: A 3D Solution
Zhu, X., Lei, Z., Liu, X., Shi, H., & Li, S. Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.23 · Cited by 1,137
Social Attributions from Faces: Determinants, Consequences, Accuracy, and Functional Significance
Todorov, A., Olivola, C. Y., Dotsch, R., & Mende-Siedlecki, P. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143831 · Cited by 1,034
Deep face recognition: A survey
Wang, M., & Deng, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.081 · Cited by 996
A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition
Bowyer, K. W., Chang, K., & Flynn, P. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.05.005 · Cited by 979
2D and 3D face recognition: A survey
Abate, A. F., Nappi, M., Riccio, D., & Sabatino, G. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.12.018 · Cited by 876
Frontal to profile face verification in the wild
Sengupta, S., Chen, J.-C., Castillo, C., Patel, V. M., Chellappa, R., & Jacobs, D. W. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477558 · Cited by 805
The CAS-PEAL large-scale chinese face database and baseline evaluations
Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., & Zhao, D. (2008) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2007.909557 · Cited by 773
Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set
Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., & Tong, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00038 · Cited by 763
50 years of biometric research: Accomplishments, challenges, and opportunities
Jain, A. K., Nandakumar, K., & Ross, A. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.12.013 · Cited by 708
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706
Soft Rasterizer: A Differentiable Renderer for Image-Based 3D Reasoning
Liu, S., Chen, W., Li, T., & Li, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00780 · Cited by 641
Learning to generate chairs with convolutional neural networks
Dosovitskiy, A., Springenberg, J. T., & Brox, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298761 · Cited by 640
Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Mobahi, H., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.112 · Cited by 629
Gabor-based kernel pca with fractional power polynomial models for face recognition
Liu, C. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273927 · Cited by 585
Elected in 100 milliseconds: Appearance-Based Trait Inferences and Voting
Olivola, C. Y., & Todorov, A. (2010) · Journal of Nonverbal Behavior · doi:10.1007/s10919-009-0082-1 · Cited by 574
Robust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Regressing Robust and Discriminative 3D Morphable Models with a Very Deep Neural Network
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.163 · Cited by 503
Face recognition across pose: A review
Zhang, X., & Gao, Y. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.04.017 · Cited by 484
3D Morphable Face Models—Past, Present, and Future
Egger, B., Smith, W. A. P., Tewari, A., Wuhrer, S., Zollhoefer, M., Beeler, T., Bernard, F., Bolkart, T., Kortylewski, A., Romdhani, S., et al. (2020) · ACM Transactions on Graphics · doi:10.1145/3395208 · Cited by 448
Self-citationFace recognition with learning-based descriptor
Cao, Z., Yin, Q., Tang, X., & Sun, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539992 · Cited by 430
Face anti-spoofing using patch and depth-based CNNs
Atoum, Y., Liu, Y., Jourabloo, A., & Liu, X. (2017) · 2017 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272713 · Cited by 429
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
Accelerating 3D deep learning with PyTorch3D
Johnson, J., Ravi, N., Reizenstein, J., Novotny, D., Tulsiani, S., Lassner, C., & Branson, S. (2020) · SIGGRAPH Asia 2020 Courses · doi:10.1145/3415263.3419160 · Cited by 413
Nonlinear 3D Face Morphable Model
Tran, L., & Liu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00767 · Cited by 407
Face Alignment in Full Pose Range: A 3D Total Solution
Zhu, X., Liu, X., Lei, Z., & Li, S. Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778152 · Cited by 391
Static and dynamic 3D facial expression recognition: A comprehensive survey
Sandbach, G., Zafeiriou, S., Pantic, M., & Yin, L. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.005 · Cited by 357
“Notably, the most well-known publicly available 3DMM is the one presented in [10,11] and has recently been made publicly available in [18].”
BackgroundA 3D Morphable Model Learnt from 10,000 Faces
Booth, J., Roussos, A., Zafeiriou, S., Ponniah, A., & Dunaway, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.598 · Cited by 353
Berg, T. L., Berg, A. C., Edwards, J., Maire, M., White, R., Teh, Y.-W., Learned-Miller, E., & Forsyth, D. A. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315253 · Cited by 339
Matching 2.5D face scans to 3D models
Lu, X., Jain, A. K., & Colbry, D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.15 · Cited by 339
Multi-view 3D Models from Single Images with a Convolutional Network
Tatarchenko, M., Dosovitskiy, A., & Brox, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_20 · Cited by 337
Large Scale 3D Morphable Models
Booth, J., Roussos, A., Ponniah, A., Dunaway, D., & Zafeiriou, S. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-017-1009-7 · Cited by 329
A Comprehensive Survey on Pose-Invariant Face Recognition
Ding, C., & Tao, D. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2845089 · Cited by 329
Automatic feature localisation with constrained local models
Cristinacce, D., & Cootes, T. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2008.01.024 · Cited by 320
Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking
Hampapur, A., Brown, L., Connell, J., Ekin, A., Haas, N., Lu, M., Merkl, H., & Pankanti, S. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1406476 · Cited by 318
DeepFake Detection Based on Discrepancies Between Faces and Their Context
Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3093446 · Cited by 312
Automatic determination of facial muscle activations from sparse motion capture marker data
Sifakis, E., Neverov, I., & Fedkiw, R. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073208 · Cited by 312
Unsupervised Training for 3D Morphable Model Regression
Genova, K., Cole, F., Maschinot, A., Sarna, A., Vlasic, D., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00874 · Cited by 311
GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction
Gecer, B., Ploumpis, S., Kotsia, I., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00125 · Cited by 303
Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference
Sanderson, C., & Lovell, B. C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01793-3_21 · Cited by 301
Romdhani, S., & Vetter, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.145 · Cited by 299
Self-citationLocally Linear Regression for Pose-Invariant Face Recognition
Chai, X., Shan, S., Chen, X., & Gao, W. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.899195 · Cited by 272
Face Recognition: A Literature Review
Tolba, A. S., El-Baz, A. H., & El-Harby, A. A. (2008) · doi:10.5281/zenodo.1334651 · Cited by 265
Multi-Task Pose-Invariant Face Recognition
Ding, C., Xu, C., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2390959 · Cited by 265
Category-specific object reconstruction from a single image
Kar, A., Tulsiani, S., Carreira, J., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298807 · Cited by 255
Validation of data-driven computational models of social perception of faces.
Todorov, A., Dotsch, R., Porter, J. M., Oosterhof, N. N., & Falvello, V. B. (2013) · Emotion · doi:10.1037/a0032335 · Cited by 226
Animal biometrics: quantifying and detecting phenotypic appearance
Kühl, H. S., & Burghardt, T. (2013) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2013.02.013 · Cited by 189
A survey on face data augmentation for the training of deep neural networks
Wang, X., Wang, K., & Lian, S. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04748-3 · Cited by 141
Face Forgery Detection by 3D Decomposition
Zhu, X., Wang, H., Fei, H., Lei, Z., & Li, S. Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00295 · Cited by 106
“Specifically, we introduce 3D Morphable Model (3DMM) [3] and the computer graphics rendering to simulate the generation of a face image.”
MethodFace matching and retrieval in forensics applications
Jain, A. K., Klare, B., & Park, U. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.4 · Cited by 105
Human Facial Expression Recognition using a 3D Morphable Model
Ramanathan, S., Kassim, A., Venkatesh, Y. V., & Wah, W. S. (2006) · 2006 International Conference on Image Processing · doi:10.1109/icip.2006.312417 · Cited by 62
“The feature points are either manually marked [4, 5] or, alternatively, a dense point-to-point correspondence is established between the reference face and the novel test face, using optical flow-like methods [6].”
BackgroundMethod3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest
Kittler, J., Hilton, A., Hamouz, M., & Illingworth, J. (2006) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops · doi:10.1109/cvpr.2005.377 · Cited by 45
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Cui, J., Li, H., Zhan, Y., Shang, H., Cheng, K., Ma, Y., Mu, S., Zhou, H., Wang, J., & Zhu, S. (2024) · arXiv · doi:10.48550/arxiv.2412.00733 · Cited by 32
Robust 3D face modeling and reconstruction from frontal and side images
Jin, H., Wang, X., Zhong, Z., & Hua, J. (2017) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2016.11.001 · Cited by 24
Metadata
- Authors
- Blanz, V., & Vetter, T.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2003-09
- Volume
- 25
- Issue
- 9
- Pages
- 1063-1074
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2160126058
- Cited by
- 2,002
- References
- 37
- FWCI
- 88.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.