The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Online modeling for realtime facial animation
Open accessAbstract
We present a new algorithm for realtime face tracking on commodity RGB-D sensing devices. Our method requires no user-specific training or calibration, or any other form of manual assistance, thus enabling a range of new applications in performance-based facial animation and virtual interaction at the consumer level. The key novelty of our approach is an optimization algorithm that jointly solves for a detailed 3D expression model of the user and the corresponding dynamic tracking parameters. Realtime performance and robust computations are facilitated by a novel subspace parameterization of the dynamic facial expression space. We provide a detailed evaluation that shows that our approach significantly simplifies the performance capture workflow, while achieving accurate facial tracking for realtime applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Efficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945
Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods
Barrett, R., Berry, M., Chan, T. F., Demmel, J., Donato, J., Dongarra, J., Eijkhout, V., Pozo, R., Romine, C., & van der Vorst, H. (1994) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611971538 · Cited by 3,479
Penalized Regressions: The Bridge versus the Lasso
Fu, W. J. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474784 · Cited by 1,092
Deformation transfer for triangle meshes
Sumner, R. W., & Popović, J. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015736 · Cited by 1,052
Methods for Non-Linear Least Squares Problems
Madsen, K., Nielsen, H. B., & Tingleff, O. (1999) · Cited by 969
Botsch, M., Kobbelt, L., Pauly, M., Alliez, P., & Levy, B. (2010) · A K Peters/CRC Press eBooks · doi:10.1201/b10688 · Cited by 814
Self-citationTemplates for the Solution of Linear Systems: Building Blocks for Iterative Methods.
S., G. W., Barrett, R., Berry, M., Chan, T. F.-C., Demmel, J. W., Donato, J. M., Dongarra, J. J., Eijkhout, V. L., Pozo, R., Romine, C. H., et al. (1995) · Mathematics of Computation · doi:10.2307/2153507 · Cited by 774
Spacetime faces: high resolution capture for modeling and animation
Zhang, L., Snavely, N., Curless, B., & Seitz, S. M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015759 · Cited by 493
Realtime performance-based facial animation
Weise, T., Bouaziz, S., Li, H., & Pauly, M. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964972 · Cited by 460
Self-citationPerformance-driven facial animation
Williams, L. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185856 · Cited by 418
Realtime performance-based facial animation
Weise, T., Bouaziz, S., Li, H., & Pauly, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964972 · Cited by 356
Self-citation3D Constrained Local Model for rigid and non-rigid facial tracking
Baltrusaitis, T., Robinson, P., & Morency, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247980 · Cited by 313
High-quality passive facial performance capture using anchor frames
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., & Gross, M. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964970 · Cited by 238
Methods for Non-Linear Least Squares Problems (2nd ed.)
Madsen, K., Nielsen, H. B., & Tingleff, O. (2004) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · Cited by 238
High resolution passive facial performance capture
Bradley, D., Heidrich, W., Popa, T., & Sheffer, A. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778778 · Cited by 233
High-quality passive facial performance capture using anchor frames
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., & Gross, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964970 · Cited by 223
Face/Off: live facial puppetry
Weise, T., Li, H., Van Gool, L., & Pauly, M. (2009) · Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation · doi:10.1145/1599470.1599472 · Cited by 194
Self-citationLi, H., Weise, T., & Pauly, M. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778769 · Cited by 188
Self-citationVision-based control of 3D facial animation
Chai, J., Xiao, J., & Hodgins, J. K. (2003) · Symposium on Computer Animation · doi:10.5555/846276.846304 · Cited by 161
Animating blendshape faces by cross-mapping motion capture data
Deng, Z., Chiang, P.-Y., Fox, P., & Neumann, U. (2006) · ACM Symposium on Interactive 3D Graphics and Games · doi:10.1145/1111411.1111419 · Cited by 156
Lightweight binocular facial performance capture under uncontrolled lighting
Valgaerts, L., Wu, C., Bruhn, A., Seidel, H., & Theobalt, C. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366206 · Cited by 143
Facial performance synthesis using deformation-driven polynomial displacement maps
Ma, W., Jones, A., Chiang, J.-Y., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., & Debevec, P. E. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409074 · Cited by 136
Bruno Lévy, B., & Zhang, H. (2010) · ACM SIGGRAPH Courses · doi:10.1145/1837101.1837109 · Cited by 94
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
Huang, H., Chai, J., Tong, X., & Wu, H. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964969 · Cited by 88
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
Huang, H., Chai, J., Tong, X., & Wu, H. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964969 · Cited by 87
Dense 3D motion capture for human faces
Furukawa, Y., & Ponce, J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206868 · Cited by 86
Pose-Space Animation and Transfer of Facial Details
Bickel, B., Lang, M., Botsch, M., Otaduy, M. Á., & Groß, M. H. (2008) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 84
Real-time avatar animation from a single image
Saragih, J., Lucey, S., & Cohn, J. F. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771383 · Cited by 76
Dense 3D motion capture for human faces
Furukawa, Y., & Ponce, J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206868 · Cited by 46
Mirror MoCap: Automatic and efficient capture of dense 3D facial motion parameters from video
Lin, I., & Ouhyoung, M. (2005) · The Visual Computer · doi:10.1007/s00371-005-0291-5 · Cited by 33
Real-time avatar animation from a single image
Saragih, J., Lucey, S., & Cohn, J. F. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771400 · Cited by 32
Cited by
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Learning a model of facial shape and expression from 4D scans
Li, T., Bolkart, T., Black, M. J., Li, H., & Romero, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130813 · Cited by 1,223
Nerfies: Deformable Neural Radiance Fields
Park, K., Sinha, U., Barron, J. T., Bouaziz, S., Goldman, D. B., Seitz, S. M., & Martin-Brualla, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00581 · Cited by 1,059
Self-citationGenerating 3D Faces Using Convolutional Mesh Autoencoders
Ranjan, A., Bolkart, T., Sanyal, S., & Black, M. J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_43 · Cited by 560
Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction
Gafni, G., Thies, J., Zollhofer, M., & Niesner, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00854 · Cited by 501
Metadata
- Authors
- Bouaziz, S., Wang, Y., & Pauly, M.
- Venue
- ACM Transactions on Graphics
- Published
- 2013-07-21
- Volume
- 32
- Issue
- 4
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W1973757125
- Cited by
- 273
- References
- 33
- FWCI
- 28.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.