The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
Abstract
Human faces are remarkably similar in global properties, including size, aspect ratio, and location of main features, but can vary considerably in details across individuals, gender, race, or due to facial expression. We propose a novel method for 3D shape recovery of faces that exploits the similarity of faces. Our method obtains as input a single image and uses a mere single 3D reference model of a different person's face. Classical reconstruction methods from single images, i.e., shape-from-shading, require knowledge of the reflectance properties and lighting as well as depth values for boundary conditions. Recent methods circumvent these requirements by representing input faces as combinations (of hundreds) of stored 3D models. We propose instead to use the input image as a guide to "mold" a single reference model to reach a reconstruction of the sought 3D shape. Our method assumes Lambertian reflectance and uses harmonic representations of lighting. It has been tested on images taken under controlled viewing conditions as well as on uncontrolled images downloaded from the Internet, demonstrating its accuracy and robustness under a variety of imaging conditions and overcoming significant differences in shape between the input and reference individuals including differences in facial expressions, gender, and race.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
The psychology of computer vision
Rosenfeld, A. (1976) · Artificial Intelligence · doi:10.1016/0004-3702(76)90008-4 · Cited by 2,966
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0054760 · Cited by 2,195
Zhang, R., Tsai, P.-S., Cryer, J. E., & Shah, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.784284 · Cited by 1,731
Lambertian reflectance and linear subspaces
Basri, R., & Jacobs, D. W. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1177153 · Cited by 1,576
Self-citationThe Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields
Black, M. J., & Anandan, P. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0006 · Cited by 1,570
Perception of shape from shading
Ramachandran, V. S. (1988) · Nature · doi:10.1038/331163a0 · Cited by 674
A Viscosity Solutions Approach to Shape-From-Shading
Rouy, E., & Tourin, A. (1992) · SIAM Journal on Numerical Analysis · doi:10.1137/0729053 · Cited by 657
Automatic interpretation and coding of face images using flexible models
Lanitis, A., Taylor, C. J., & Cootes, T. F. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598231 · Cited by 625
The quotient image: class-based re-rendering and recognition with varying illuminations
Shashua, A., & Riklin-Raviv, T. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908964 · Cited by 615
Obtaining Shape from Shading Information
Horn, B. K. P. (1975) · The MIT Press eBooks · Cited by 463
Estimation of illuminant direction, albedo, and shape from shading
Zheng, Q., & Chellappa, R. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85658 · Cited by 385
Ramamoorthi, R., & Hanrahan, P. (2001) · Journal of the Optical Society of America A · doi:10.1364/josaa.18.002448 · Cited by 377
Hernandez Esteban, C., Vogiatzis, G., & Cipolla, R. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70820 · Cited by 301
Direct visibility of point sets
Katz, S., Tal, A., & Basri, R. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276407 · Cited by 269
Self-citationAtick, J. J., Griffin, P. A., & Redlich, A. N. (1996) · Neural Computation · doi:10.1162/neco.1996.8.6.1321 · Cited by 269
Finding the illuminant direction
Pentland, A. P. (1982) · Journal of the Optical Society of America · doi:10.1364/josa.72.000448 · Cited by 244
Direct visibility of point sets
Katz, S., Tal, A., & Basri, R. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276407 · Cited by 230
Self-citationOptimal Algorithm for Shape from Shading and Path Planning
Kimmel, R., & Sethian, J. A. (2001) · Journal of Mathematical Imaging and Vision · doi:10.1023/a:1011234012449 · Cited by 207
Character animation from 2D pictures and 3D motion data
Hornung, A., Dekkers, E., & Kobbelt, L. (2007) · ACM Transactions on Graphics · doi:10.1145/1189762.1189763 · Cited by 180
Face recognition under variable lighting using harmonic image exemplars
Zhang, L., & Samaras, D. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211333 · Cited by 141
Generalization to Novel Images in Upright and Inverted Faces
Moses, Y., Ullman, S., & Edelman, S. (1996) · Perception · doi:10.1068/p250443 · Cited by 114
ShadowCuts: Photometric Stereo with Shadows
Chandraker, M. K., Agarwal, S., & Kriegman, D. J. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383288 · Cited by 109
Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces
Dovgard, R., & Basri, R. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24671-8_8 · Cited by 102
Self-citationVisual perception in people and machines
Ramachandran, V. S. (1990) · Medical Entomology and Zoology · Cited by 76
Cited by
3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction
Choy, C. B., Xu, D., Gwak, J., Chen, K., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_38 · Cited by 1,632
Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network
Feng, Y., Wu, F., Shao, X., Wang, Y., & Zhou, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_33 · Cited by 767
Effective face frontalization in unconstrained images
Hassner, T., Harel, S., Paz, E., & Enbar, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299058 · Cited by 613
Regressing Robust and Discriminative 3D Morphable Models with a Very Deep Neural Network
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.163 · Cited by 503
Static and dynamic 3D facial expression recognition: A comprehensive survey
Sandbach, G., Zafeiriou, S., Pantic, M., & Yin, L. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.005 · Cited by 357
Metadata
- Authors
- Kemelmacher-Shlizerman, I., & Basri, R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-02
- Volume
- 33
- Issue
- 2
- Pages
- 394-405
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2146566773
- Cited by
- 428
- References
- 26
- FWCI
- 24.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.