Scalable muscle-actuated human simulation and control
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Many anatomical factors, such as bone geometry and muscle condition, interact to affect human movements. This work aims to build a comprehensive musculoskeletal model and its control system that reproduces realistic human movements driven by muscle contraction dynamics. The variations in the anatomic model generate a spectrum of human movements ranging from typical to highly stylistic movements. To do so, we discuss scalable and reliable simulation of anatomical features, robust control of under-actuated dynamical systems based on deep reinforcement learning, and modeling of pose-dependent joint limits. The key technical contribution is a scalable, two-level imitation learning algorithm that can deal with a comprehensive full-body musculoskeletal model with 346 muscles. We demonstrate the predictive simulation of dynamic motor skills under anatomical conditions including bone deformity, muscle weakness, contracture, and the use of a prosthesis. We also simulate various pathological gaits and predictively visualize how orthopedic surgeries improve post-operative gaits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
(2017) · Cited by 11,625
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 1×
“The two networks π θ ( s ) and V π ( s ) are iteratively updated at the training step [Lillicrap et al. 2015; Schulman et al. 2015, 2017].”
MethodProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483 · cited 1×
“We used IPOPT [Wachter and Biegler 2006] to solve for the frames.”
MethodOpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement
Delp, S. L., Anderson, F. C., Arnold, A. S., Loan, P., Habib, A., John, C. T., Guendelman, E., & Thelen, D. G. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.901024 · Cited by 4,933 · cited 1×
“Ever since prototype systems have been built and released [Damsgaard et al. 2006; Delp et al. 2007; Lloyd et al. 2012], muscle-based modeling and simulation have gained a lot of attention in both Biomechanics and Computer Graphics.”
BackgroundTrust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578 · cited 1×
“The two networks π θ ( s ) and V π ( s ) are iteratively updated at the training step [Lillicrap et al. 2015; Schulman et al. 2015, 2017].”
MethodMuscle and tendon: properties, models, scaling, and application to biomechanics and motor control.
Zajac, F. E. (1989) · PubMed · Cited by 3,673
DeepMimic: example-guided deep reinforcement learning of physics-based character skills
Peng, X. B., Abbeel, P., Levine, S., & van de Panne, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201311 · Cited by 1,784 · cited 4×
“The control policy represented by deep neural networks has successfully reproduced highly-detailed human movements including walking, running, cartwheel, and flip-ping [Peng et al. 2018a].”
BackgroundMethodInfluentialAnalysis of musculoskeletal systems in the AnyBody Modeling System
Damsgaard, M., Rasmussen, J., Christensen, S. T., Surma, E., & de Zee, M. (2006) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2006.09.001 · Cited by 1,031 · cited 1×
“Ever since prototype systems have been built and released [Damsgaard et al. 2006; Delp et al. 2007; Lloyd et al. 2012], muscle-based modeling and simulation have gained a lot of attention in both Biomechanics and Computer Graphics.”
Background
Cited by
AMP: adversarial motion priors for stylized physics-based character control
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 396
Learning Agile Robotic Locomotion Skills by Imitating Animals
Bin Peng, X., Coumans, E., Zhang, T., Lee, T.-W., Tan, J., & Levine, S. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.064 · Cited by 357
Character controllers using motion VAEs
Ling, H. Y., Zinno, F., Cheng, G., & Van De Panne, M. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392422 · Cited by 253
From motor control to team play in simulated humanoid football
Liu, S., Lever, G., Wang, Z., Merel, J., Eslami, S. M. A., Hennes, D., Czarnecki, W. M., Tassa, Y., Omidshafiei, S., Abdolmaleki, A., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abo0235 · Cited by 88
A Whole-Body Musculoskeletal Model of the Mouse
Tata Ramalingasetty, S., Danner, S. M., Arreguit, J., Markin, S. N., Rodarie, D., Kathe, C., Courtine, G., Rybak, I. A., & Ijspeert, A. J. (2021) · IEEE Access · doi:10.1109/access.2021.3133078 · Cited by 35
“However, in current framework, muscle paths were approximated as linear polyline paths similar to [18], [26], [48].”
MethodHuman Motion Control of Quadrupedal Robots using Deep Reinforcement Learning
Kim, S., Sorokin, M., Lee, J., & Ha, S. (2022) · Robotics: Science and Systems XVIII · doi:10.15607/rss.2022.xviii.021 · Cited by 9
Self-citation
Metadata
- Authors
- Lee, S., Park, M., Lee, K., & Lee, J.
- Venue
- ACM Transactions on Graphics
- Published
- 2019-07-12
- Volume
- 38
- Issue
- 4
- Pages
- 1-13
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2958043083
- Cited by
- 203
- References
- 50
- FWCI
- 15.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.