Data-driven physics for human soft tissue animation
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Data driven models of human poses and soft-tissue deformations can produce very realistic results, but they only model the visible surface of the human body and cannot create skin deformation due to interactions with the environment. Physical simulations can generalize to external forces, but their parameters are difficult to control. In this paper, we present a layered volumetric human body model learned from data. Our model is composed of a data-driven inner layer and a physics-based external layer. The inner layer is driven with a volumetric statistical body model (VSMPL). The soft tissue layer consists of a tetrahedral mesh that is driven using the finite element method (FEM). Model parameters, namely the segmentation of the body into layers and the soft tissue elasticity, are learned directly from 4D registrations of humans exhibiting soft tissue deformations. The learned two layer model is a realistic full-body avatar that generalizes to novel motions and external forces. Experiments show that the resulting avatars produce realistic results on held out sequences and react to external forces. Moreover, the model supports the retargeting of physical properties from one avatar when they share the same topology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734
Self-citationSCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Automatic rigging and animation of 3D characters
Baran, I., & Popović, J. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276467 · Cited by 495 · cited 1×
“…the skinning quality heavily depends on the skinning weights, and researchers have developed techniques for computing the weights either automatically [Baran and Popović 2007; Dionne and de Lasa 2013; Jacobson et al. 2012, 2011; Kavan and Sorkine 2012] or from examples [Wang and Phillips 2002].”
MethodJames, D. L., & Twigg, C. D. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073206 · Cited by 361
Bounded biharmonic weights for real-time deformation
Jacobson, A., Baran, I., Popović, J., & Sorkine, O. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964973 · Cited by 258
Capturing and animating skin deformation in human motion
Park, S. I., & Hodgins, J. K. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141970 · Cited by 202
Efficient dynamic skinning with low-rank helper bone controllers
Mukai, T., & Kuriyama, S. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925905 · Cited by 31
Cited by
ClothCap: seamless 4D clothing capture and retargeting
Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073711 · Cited by 495
Self-citationDeepCap: Monocular Human Performance Capture Using Weak Supervision
Habermann, M., Xu, W., Zollhofer, M., Pons-Moll, G., & Theobalt, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00510 · Cited by 214
Self-citationXu, Z., Zhou, Y., Kalogerakis, E., Landreth, C., & Singh, K. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392379 · Cited by 126
“A wide range of approaches have also been proposed to model skin deformations, ranging from physics-based methods [Kim et al. 2017; Komaritzan and Botsch 2018, 2019; Mukai and Kuriyama 2016; Si et al. 2015], geometric methods [Bang and Lee 2018; Dionne and de Lasa 2013; Dionne and de Lasa 2014;…”
MethodNeuroSkinning: automatic skin binding for production characters with deep graph networks
Liu, L., Zheng, Y., Tang, D., Yuan, Y., Fan, C., & Zhou, K. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322969 · Cited by 67
“Skinning techniques can be roughly divided into physics-based [Kim et al. 2017; Mukai and Kuriyama 2016; Si et al. 2014], example-based [Le and Deng 2014; Loper et al. 2015], and geometry-based methods [Kavan et al. 2007; Kavan and Žára 2005].”
MethodNNWarp: Neural Network-based Nonlinear Deformation
Luo, R., Shao, T., Wang, H., Xu, W., Chen, X., Zhou, K., & Yang, Y. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2881451 · Cited by 50
“[43] combined the physics-based simulation and data-driven to produce realistic soft tissue animation.”
BackgroundRigNet: Neural Rigging for Articulated Characters
Xu, Z., Zhou, Y., Kalogerakis, E., Landreth, C., & Singh, K. (2020) · arXiv · doi:10.48550/arxiv.2005.00559 · Cited by 13
“A wide range of approaches have also been proposed to model skin deformations, ranging from physics-based methods [Kim et al. 2017; Komaritzan and Botsch 2018, 2019; Mukai and Kuriyama 2016; Si et al. 2015], geometric methods [Bang and Lee 2018; Dionne and de Lasa 2013; Dionne and de Lasa 2014;…”
MethodSkin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging
Zhang, J.-P., Pu, C.-F., Guo, M.-H., Cao, Y.-P., & Hu, S.-M. (2026) · arXiv · doi:10.48550/arxiv.2602.04805
“And skeleton-driven animation[Abu Rum-man and Fratarcangeli 2015; Kim et al. 2017] is still an important part of the computer graphics industry, with rigging being an indispensable component.”
Metadata
- Authors
- Kim, M., Pons-Moll, G., Pujades, S., Bang, S., Kim, J., Black, M. J., & Lee, S.-H.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2738138368
- Cited by
- 109
- References
- 7
- FWCI
- 13.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.