The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
A 3D Face Model for Pose and Illumination Invariant Face Recognition
Abstract
Generative 3D face models are a powerful tool in computer vision. They provide pose and illumination invariance by modeling the space of 3D faces and the imaging process. The power of these models comes at the cost of an expensive and tedious construction process, which has led the community to focus on more easily constructed but less powerful models. With this paper we publish a generative 3D shape and texture model, the Basel face model (BFM), and demonstrate its application to several face recognition task. We improve on previous models by offering higher shape and texture accuracy due to a better scanning device and less correspondence artifacts due to an improved registration algorithm. The same 3D face model can be fit to 2D or 3D images acquired under different situations and with different sensors using an analysis by synthesis method. The resulting model parameters separate pose, lighting, imaging and identity parameters, which facilitates invariant face recognition across sensors and data sets by comparing only the identity parameters. We hope that the availability of this registered face model will spur research in generative models. Together with the model we publish a set of detailed recognition and reconstruction results on standard databases to allow complete algorithm comparisons.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Self-citationThe FERET evaluation methodology for face-recognition algorithms
Phillips, P. J., Moon, H., Rizvi, S. A., & Rauss, P. J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879790 · Cited by 3,692
Face recognition based on fitting a 3D morphable model
Blanz, V., & Vetter, T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227983 · Cited by 2,002
Self-citationThe CMU pose, illumination, and expression database
Sim, T., Baker, S., & Bsat, M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251154 · Cited by 1,783
The CMU Pose, Illumination, and Expression (PIE) database
Sim, T., Baker, S., & Bsat, M. (2003) · Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition · doi:10.1109/afgr.2002.1004130 · Cited by 1,419
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882311 · Cited by 913
Prototype-referenced shape encoding revealed by high-level aftereffects
Leopold, D. A., O'Toole, A. J., Vetter, T., & Blanz, V. (2001) · Nature Neuroscience · doi:10.1038/82947 · Cited by 875
Self-citationOptimal Step Nonrigid ICP Algorithms for Surface Registration
Amberg, B., Romdhani, S., & Vetter, T. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383165 · Cited by 746
Self-citationVideo-based face recognition using probabilistic appearance manifolds
Lee, K.-C., Ho, J., Yang, M.-H., & Kriegman, D. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211369 · Cited by 454
Cited by
Expressive Body Capture: 3D Hands, Face, and Body From a Single Image
Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A., Tzionas, D., & Black, M. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01123 · Cited by 1,781
Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
Kim, T., Cha, M., Kim, H., Lee, J. K., & Kim, J. (2017) · arXiv · doi:10.48550/arxiv.1703.05192 · Cited by 1,716
RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild
Deng, J., Guo, J., Ververas, E., Kotsia, I., & Zafeiriou, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00525 · Cited by 1,681
Learning a model of facial shape and expression from 4D scans
Li, T., Bolkart, T., Black, M. J., Li, H., & Romero, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130813 · Cited by 1,223
Jointly Embedding Multiple Single-Cell Omics Measurements
Liu, J., Huang, Y., Singh, R., Vert, J., & Noble, W. S. (2019) · Leibniz international proceedings in informatics · doi:10.4230/lipics.wabi.2019.10 · Cited by 1,141
Visual interpretability for deep learning: a survey
Zhang, Q.-S., & Zhu, S.-C. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700808 · Cited by 950
Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set
Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., & Tong, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00038 · Cited by 763
Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision
Liu, Y., Jourabloo, A., & Liu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00048 · Cited by 712
Learning an animatable detailed 3D face model from in-the-wild images
Feng, Y., Feng, H., Black, M. J., & Bolkart, T. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459936 · Cited by 660
Deep Convolutional Inverse Graphics Network
Kulkarni, T. D., Whitney, W., Kohli, P., & Tenenbaum, J. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03167 · Cited by 653
Kim, H., & Mnih, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05983 · Cited by 617
Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination
Zhao, Q., Zhang, L., & Cichocki, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2392756 · Cited by 587
Random Forests for Real Time 3D Face Analysis
Fanelli, G., Dantone, M., Gall, J., Fossati, A., & Van Gool, L. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0549-0 · Cited by 566
Generating 3D Faces Using Convolutional Mesh Autoencoders
Ranjan, A., Bolkart, T., Sanyal, S., & Black, M. J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_43 · Cited by 560
Regressing Robust and Discriminative 3D Morphable Models with a Very Deep Neural Network
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.163 · Cited by 503
Robust Face Recognition via Multimodal Deep Face Representation
Ding, C., & Tao, D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477042 · Cited by 449
“In this paper, we consistently employ the mean shape of the Basel Face Model as the generic 3D face model [34].”
MethodLarge Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression
Jackson, A. S., Bulat, A., Argyriou, V., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.117 · Cited by 449
3D Morphable Face Models—Past, Present, and Future
Egger, B., Smith, W. A. P., Tewari, A., Wuhrer, S., Zollhoefer, M., Beeler, T., Bernard, F., Bolkart, T., Kortylewski, A., Romdhani, S., et al. (2020) · ACM Transactions on Graphics · doi:10.1145/3395208 · Cited by 448
Self-citationReal time head pose estimation with random regression forests
Fanelli, G., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995458 · Cited by 436
SimSwap: An Efficient Framework For High Fidelity Face Swapping
Chen, R., Chen, X., Ni, B., & Ge, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413630 · Cited by 418
“Nirkin et al. [27] utilized a 3D face dataset [29] to transfer the expression and posture and then used Poisson Blending [30] to merge the source face into the target image.”
MethodNonlinear 3D Face Morphable Model
Tran, L., & Liu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00767 · Cited by 407
Face Alignment in Full Pose Range: A 3D Total Solution
Zhu, X., Liu, X., Lei, Z., & Li, S. Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778152 · Cited by 391
A 3D Morphable Model Learnt from 10,000 Faces
Booth, J., Roussos, A., Zafeiriou, S., Ponniah, A., & Dunaway, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.598 · Cited by 353
HoloGAN: Unsupervised Learning of 3D Representations From Natural Images
Nguyen-Phuoc, T., Li, C., Theis, L., Richardt, C., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00768 · Cited by 340
Do We Really Need to Collect Millions of Faces for Effective Face Recognition?
Masi, I., Trần, A. T., Hassner, T., Leksut, J. T., & Medioni, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_35 · Cited by 339
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning
Deng, Y., Yang, J., Chen, D., Wen, F., & Tong, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00520 · Cited by 329
Large Scale 3D Morphable Models
Booth, J., Roussos, A., Ponniah, A., Dunaway, D., & Zafeiriou, S. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-017-1009-7 · Cited by 329
Recent Advances in Autoencoder-Based Representation Learning
Tschannen, M., Bachem, O., & Lučić, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05069 · Cited by 329
A Comprehensive Survey on Pose-Invariant Face Recognition
Ding, C., & Tao, D. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2845089 · Cited by 329
FaceScape: A Large-Scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction
Yang, H., Zhu, H., Wang, Y., Huang, M., Shen, Q., Yang, R., & Cao, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00068 · Cited by 315
Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting
Jourabloo, A., & Liu, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.454 · Cited by 296
On Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tran Tuan, A., Hassner, T., & Medioni, G. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00024 · Cited by 285
Realtime facial animation with on-the-fly correctives
Li, H., Yu, J., Ye, Y., & Bregler, C. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462019 · Cited by 282
Morphable Face Models - An Open Framework
Gerig, T., Morel-Forster, A., Blumer, C., Egger, B., Luthi, M., Schoenborn, S., & Vetter, T. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00021 · Cited by 268
Self-citationGenerative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2022) · ACM Computing Surveys · doi:10.1145/3439723 · Cited by 267
“InfoGAN MNIST, 3D face images [87], 3D chair images [88], SVHN and CelebA.”
MethodMulti-Task Pose-Invariant Face Recognition
Ding, C., Xu, C., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2390959 · Cited by 265
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01529 · Cited by 255
End-to-End 3D Face Reconstruction with Deep Neural Networks
Dou, P., Shah, S. K., & Kakadiaris, I. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.164 · Cited by 254
Deep Kinematic Pose Regression
Zhou, X., Sun, X., Zhang, W., Liang, S., & Wei, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_17 · Cited by 253
Face Forgery Detection by 3D Decomposition
Zhu, X., Wang, H., Fei, H., Lei, Z., & Li, S. Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00295 · Cited by 106
“For the facial detail generation, we construct the 3D face shape by 3DDFA [43, 17], perform UV warping by the UV map in [15], and acquire the common texture by fitting the PCA texture model in Basel Face Model (BFM) [26].”
MethodUncertainty-Aware Mesh Decoder for High Fidelity 3D Face Reconstruction
Lee, G.-H., & Lee, S.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00614 · Cited by 70
Face Forgery Detection by 3D Decomposition and Composition Search
Zhu, X., Fei, H., Zhang, B., Zhang, T., Zhang, X., Li, S. Z., & Lei, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3233586 · Cited by 41
Yu, H., & Welch, J. D. (2021) · Genome Biology · doi:10.1186/s13059-021-02373-4 · Cited by 38
Vision-Based Mouth Motion Analysis in Epilepsy: A 3D Perspective
Ahmedt-Aristizabal, D., Nguyen, K., Denman, S., Sarfraz, M. S., Sridharan, S., Dionisio, S., & Fookes, C. (2019) · 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857656 · Cited by 17
Metadata
- Authors
- Paysan, P., Knothe, R., Amberg, B., Romdhani, S., & Vetter, T.
- Venue
- 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 296-301
- OpenAlex
- W2107037917
- Cited by
- 1,326
- References
- 19
- FWCI
- 13.36
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.