A morphable model for the synthesis of 3D faces
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In this paper, a new technique for modeling textured 3D faces is introduced. 3D faces can either be generated automatically from one or more photographs, or modeled directly through an intuitive user interface. Users are assisted in two key problems of computer aided face modeling. First, new face images or new 3D face models can be registered automatically by computing dense one-to-one correspondence to an internal face model. Second, the approach regulates the naturalness of modeled faces avoiding faces with an "unlikely" appearance. Starting from an example set of 3D face models, we derive a morphable face model by transforming the shape and texture of the examples into a vector space representation. New faces and expressions can be modeled by forming linear combinations of the prototypes. Shape and texture constraints derived from the statistics of our example faces are used to guide manual modeling or automated matching algorithms. We show 3D face reconstructions from single images and their applications for photo-realistic image manipulations. We also demonstrate face manipulations according to complex parameters such as gender, fullness of a face or its distinctiveness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Goodall, C. (1988) · Technometrics · doi:10.1080/00401706.1988.10488412 · Cited by 8,675
Low-dimensional procedure for the characterization of human faces
Sirovich, L., & Kirby, M. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000519 · Cited by 2,311
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0054760 · Cited by 2,195
Anthropometry of the head and face
Farkas, L. G. (1994) · Raven Press eBooks · Cited by 959
Realistic modeling for facial animation
Lee, Y., Terzopoulos, D., & Walters, K. (1995) · Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95 · doi:10.1145/218380.218407 · Cited by 826
A muscle model for animation three-dimensional facial expression
Waters, K. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37405 · Cited by 740
Synthesizing realistic facial expressions from photographs
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., & Salesin, D. H. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185859 · Cited by 723
Automatic interpretation and coding of face images using flexible models
Lanitis, A., Taylor, C. J., & Cootes, T. F. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598231 · Cited by 625
Anthropometry of the head and face
Cacou, C. (1995) · British Journal of Plastic Surgery · doi:10.1016/0007-1226(95)90037-3 · Cited by 585
Computer Facial Animation, Second Edition
Parke, F. I., & Waters, K. (1996) · Medical Entomology and Zoology · Cited by 578
Computer generated animation of faces
Parke, F. I. (1972) · Proceedings of the ACM annual conference on - ACM'72 · doi:10.1145/800193.569955 · Cited by 499
A muscle model for animation three-dimensional facial expression
Waters, K. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37405 · Cited by 476
Synthesizing realistic facial expressions from photographs
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., & Salesin, D. H. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280825 · Cited by 462
Linear object classes and image synthesis from a single example image
Vetter, T., & Poggio, T. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598230 · Cited by 409
Self-citationPlatt, S. M., & Badler, N. I. (1981) · Proceedings of the 8th annual conference on Computer graphics and interactive techniques - SIGGRAPH '81 · doi:10.1145/800224.806812 · Cited by 404
Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin, F. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185858 · Cited by 387
An anthropometric face model using variational techniques
DeCarlo, D., Metaxas, D., & Stone, M. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280823 · Cited by 327
Computer facial animation: (526112012-055)
Parke, F. I. (1997) · PsycEXTRA Dataset · doi:10.1037/e526112012-055 · Cited by 310
Platt, S. M., & Badler, N. I. (1981) · ACM SIGGRAPH Computer Graphics · doi:10.1145/965161.806812 · Cited by 279
A parametric model for human faces.
Parke, F. I. (1974) · Defense Technical Information Center (DTIC) · Cited by 271
Image Representations for Visual Learning
Beymer, D., & Poggio, T. (1996) · Science · doi:10.1126/science.272.5270.1905 · Cited by 271
Dynamic NURBS with geometric constraints for interactive sculpting
Terzopoulos, D., & Qin, H. (1994) · ACM Transactions on Graphics · doi:10.1145/176579.176580 · Cited by 241
The Perception of Human Growth
Todd, J. T., Mark, L. S., Shaw, R. E., & Pittenger, J. B. (1980) · Scientific American · doi:10.1038/scientificamerican0280-132 · Cited by 239
Automatic creation of 3D facial models
Akimoto, T., Suenaga, Y., & Wallace, R. S. (1993) · IEEE Computer Graphics and Applications · doi:10.1109/38.232096 · Cited by 189
Example Based Image Analysis and Synthesis
Beymer, D., Shashua, A., & Poggio, T. (1993) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 184
Algorithms for solid noise synthesis
Lewis, J. P. (1989) · Proceedings of the 16th annual conference on Computer graphics and interactive techniques · doi:10.1145/74333.74360 · Cited by 161
Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes
Jones, M., & Poggio, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008074226832 · Cited by 131
A bootstrapping algorithm for learning linear models of object classes
Vetter, T., Jones, M. J., & Poggio, T. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609295 · Cited by 122
Self-citationEstimating coloured 3D face models from single images: An example based approach
Vetter, T. R., & Blanz, V. (1998) · Lecture notes in computer science · doi:10.1007/bfb0054761 · Cited by 111
Self-citationMultidimensional morphable models
Jones, M., & Poggio, T. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1998.710791 · Cited by 108
Algorithms for solid noise synthesis
Lewis, J. P. (1989) · ACM SIGGRAPH Computer Graphics · doi:10.1145/74334.74360 · Cited by 99
Design, transformation and animation of human faces
Magnenat‐Thalmann, N., Minh, H. T., de Angelis, M., & Thalmann, D. (1989) · The Visual Computer · doi:10.1007/bf01901479 · Cited by 77
Extending the range of facial types
DiPaola, S. (1991) · The Journal of Visualization and Computer Animation · doi:10.1002/vis.4340020406 · Cited by 68
A user-friendly texture-fitting methodology for virtual humans
Sannier, G., & Magnenat‐Thalmann, N. (2002) · Computer Graphics International · doi:10.1109/cgi.1997.601298 · Cited by 27
Cited by
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Face recognition based on fitting a 3D morphable model
Blanz, V., & Vetter, T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227983 · Cited by 2,002
Self-citationSupervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
The functional basis of face evaluation
Oosterhof, N. N., & Todorov, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805664105 · Cited by 1,819
Metadata
- Authors
- Blanz, V., & Vetter, T.
- Venue
- Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99
- Publisher
- ACM Press
- Published
- 1999
- Pages
- 187-194
- OpenAlex
- W2237250383
- Cited by
- 4,710
- References
- 35
- FWCI
- 51.56
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.