The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Large Scale 3D Morphable Models
Open accessAbstract
We present large scale facial model (LSFM)-a 3D Morphable Model (3DMM) automatically constructed from 9663 distinct facial identities. To the best of our knowledge LSFM is the largest-scale Morphable Model ever constructed, containing statistical information from a huge variety of the human population. To build such a large model we introduce a novel fully automated and robust Morphable Model construction pipeline, informed by an evaluation of state-of-the-art dense correspondence techniques. The dataset that LSFM is trained on includes rich demographic information about each subject, allowing for the construction of not only a global 3DMM model but also models tailored for specific age, gender or ethnicity groups. We utilize the proposed model to perform age classification from 3D shape alone and to reconstruct noisy out-of-sample data in the low-dimensional model space. Furthermore, we perform a systematic analysis of the constructed 3DMM models that showcases their quality and descriptive power. The presented extensive qualitative and quantitative evaluations reveal that the proposed 3DMM achieves state-of-the-art results, outperforming existing models by a large margin. Finally, for the benefit of the research community, we make publicly available the source code of the proposed automatic 3DMM construction pipeline, as well as the constructed global 3DMM and a variety of bespoke models tailored by age, gender and ethnicity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“…progress in computer vision would not be possible without the collection of large and comprehensive datasets e.g. Everingham et al. (2010), Sagonas et al. (2013), Jain and Learned-Miller (2010), Deng et al. (2009), and we believe that our publicly available models contributes towards this effort.”
Background(2008) · Journal of Machine Learning Research · Cited by 33,051
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“…is worth mentioning that current progress in computer vision would not be possible without the collection of large and comprehensive datasets e.g. Everingham et al. (2010), Sagonas et al. (2013), Jain and Learned-Miller (2010), Deng et al. (2009), and we believe that our publicly available…”
BackgroundCootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Principal warps: thin-plate splines and the decomposition of deformations
Bookstein, F. L. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.24792 · Cited by 4,913
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
Face recognition based on fitting a 3D morphable model
Blanz, V., & Vetter, T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227983 · Cited by 2,002
A 3D Face Model for Pose and Illumination Invariant Face Recognition
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., & Vetter, T. (2009) · 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance · doi:10.1109/avss.2009.58 · Cited by 1,326
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Self-citationFDDB: A benchmark for face detection in unconstrained settings
Jain, V., & Miller, E. G. (2010) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 1,072
Optimal Step Nonrigid ICP Algorithms for Surface Registration
Amberg, B., Romdhani, S., & Vetter, T. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383165 · Cited by 746
Face transfer with multilinear models
Vlasic, D., Brand, M., Pfister, H., & Popović, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073209 · Cited by 556
Localizing Parts of Faces Using a Consensus of Exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.23 · Cited by 522
Localizing parts of faces using a consensus of exemplars
Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., & Kumar, N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995602 · Cited by 518
An Improved Algorithm for TV-L 1 Optical Flow
Wedel, A., Pock, T., Zach, C., Bischof, H., & Cremers, D. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-03061-1_2 · Cited by 423
A Multiresolution 3D Morphable Face Model and Fitting Framework
Huber, P., Hu, G., Tena, R., Mortazavian, P., Koppen, W. P., Christmas, W. J., Rätsch, M., & Kittler, J. (2016) · Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0005669500790086 · Cited by 227
Expression invariant 3D face recognition with a Morphable Model
Amberg, B., Knothe, R., & Vetter, T. (2008) · 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition · doi:10.1109/afgr.2008.4813376 · Cited by 189
Cosker, D. P., Krumhuber, E. G., & Hilton, A. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126510 · Cited by 162
Menpo: A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models
Alabort-i-Medina, J., Antonakos, E., Booth, J. G., Snape, P., & Zafeiriou, S. P. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654890 · Cited by 118
Self-citationLarge-scale objective phenotyping of 3D facial morphology
Hammond, P., & Suttie, M. (2012) · Human Mutation · doi:10.1002/humu.22054 · Cited by 118
Statistical Models of Shape: Optimisation and Evaluation
Davies, R. H., Twining, C., & Taylor, C. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 114
Feature-Based Lucas–Kanade and Active Appearance Models
Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., & Zafeiriou, S. P. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2431445 · Cited by 112
Self-citationFace transfer with multilinear models
Vlasic, D., Brand, M., Pfister, H., & Popović, J. (2005) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186822.1073209 · Cited by 104
Multilinear Wavelets: A Statistical Shape Space for Human Faces
Brunton, A., Bolkart, T., & Wuhrer, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10590-1_20 · Cited by 97
3D morphable face models revisited
Patel, A., & Smith, W. A. P. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206522 · Cited by 96
Review of statistical shape spaces for 3D data with comparative analysis for human faces
Brunton, A., Salazar, A., Bolkart, T., & Wuhrer, S. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.05.005 · Cited by 87
A Groupwise Multilinear Correspondence Optimization for 3D Faces
Bolkart, T., & Wuhrer, S. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.411 · Cited by 72
Internet Based Morphable Model
Kemelmacher-Shlizerman, I. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.404 · Cited by 70
Shape-based automatic detection of a large number of 3D facial landmarks
Gilani, S. Z., Faisal Shafait, B., & Mian, A. S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299095 · Cited by 68
Heo, J., & Savvides, M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.275 · Cited by 65
Fully automatic expression-invariant face correspondence
Salazar, A., Wuhrer, S., Shu, C., & Prieto, F. (2013) · Machine Vision and Applications · doi:10.1007/s00138-013-0579-9 · Cited by 57
Describing Crouzon and Pfeiffer syndrome based on principal component analysis
Staal, F. C. R., Ponniah, A. J. T., Angullia, F., Ruff, C. F., Koudstaal, M. J., & Dunaway, D. (2015) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2015.02.005 · Cited by 50
Self-citationEthnicity- and Gender-based Subject Retrieval Using 3-D Face-Recognition Techniques
Toderici, G. D., O’Malley, S. M., Passalis, G., Theoharis, T., & Kakadiaris, I. A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0300-7 · Cited by 39
Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., et al. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025044 · Cited by 35
3D faces in motion: Fully automatic registration and statistical analysis
Bolkart, T., & Wuhrer, S. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.06.013 · Cited by 33
Optimal UV spaces for facial morphable model construction
Booth, J. G., & Zafeiriou, S. P. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025947 · Cited by 32
Self-citationWavelet Model-based Stereo for Fast, Robust Face Reconstruction
Brunton, A., Lang, J., Dubois, É., & Shu, C. (2011) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2011.53 · Cited by 17
Cited by
Expressive Body Capture: 3D Hands, Face, and Body From a Single Image
Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A., Tzionas, D., & Black, M. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01123 · Cited by 1,781
Learning a model of facial shape and expression from 4D scans
Li, T., Bolkart, T., Black, M. J., Li, H., & Romero, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130813 · Cited by 1,223
Nerfies: Deformable Neural Radiance Fields
Park, K., Sinha, U., Barron, J. T., Bouaziz, S., Goldman, D. B., Seitz, S. M., & Martin-Brualla, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00581 · Cited by 1,059
Generating 3D Faces Using Convolutional Mesh Autoencoders
Ranjan, A., Bolkart, T., Sanyal, S., & Black, M. J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_43 · Cited by 560
Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Niessner, M., Pérez, P., Richardt, C., Zollhöfer, M., & Theobalt, C. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201283 · Cited by 475
Metadata
- Authors
- Booth, J., Roussos, A., Ponniah, A., Dunaway, D., & Zafeiriou, S.
- Venue
- International Journal of Computer Vision
- Published
- 2017-04-08
- Volume
- 126
- Issue
- 2-4
- Pages
- 233-254
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2604524889
- Cited by
- 329
- References
- 38
- FWCI
- 12.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.