The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Character controllers using motion VAEs
Open accessAbstract
A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips. We learn data-driven generative models of human movement using autoregressive conditional variational autoencoders, or Motion VAEs. The latent variables of the learned autoencoder define the action space for the movement and thereby govern its evolution over time. Planning or control algorithms can then use this action space to generate desired motions. In particular, we use deep reinforcement learning to learn controllers that achieve goal-directed movements. We demonstrate the effectiveness of the approach on multiple tasks. We further evaluate system-design choices and describe the current limitations of Motion VAEs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 1×
“We solve this optimization problem using the proximal policy optimization (PPO) algorithm [Schulman et al. 2017].”
MethodGenerating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621
Kovar, L., Gleicher, M., & Pighin, F. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401202 · Cited by 1,052
On Human Motion Prediction Using Recurrent Neural Networks
Martinez, J., Black, M. J., & Romero, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.497 · Cited by 984
Auto-Encoding Variational Bayes
Chen, Y., Liu, J., Peng, L., Wu, Y., Xu, Y., & Zhang, Z. (2024) · Cambridge Explorations in Arts and Sciences · doi:10.61603/ceas.v2i1.33 · Cited by 934
DeepMimic: example-guided deep reinforcement learning of physics-based character skills
Peng, X. B., Abbeel, P., Levine, S., & van de Panne, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201311 · Cited by 880
Self-citationRecurrent Network Models for Human Dynamics
Fragkiadaki, K., Levine, S., Felsen, P., & Malik, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.494 · Cited by 860
Emergence of Locomotion Behaviours in Rich Environments
Heess, N., TB, D., Sriram, S., Lemmon, J., Merel, J., Wayne, G., Tassa, Y., Erez, T., Wang, Z., Eslami, S. M. A., et al. (2017) · arXiv · doi:10.48550/arxiv.1707.02286 · Cited by 657
A deep learning framework for character motion synthesis and editing
Holden, D., Saito, J., & Komura, T. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925975 · Cited by 655
Kovar, L., Gleicher, M., & Pighin, F. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566605 · Cited by 597
Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016) · arXiv · doi:10.48550/arxiv.1606.01540 · Cited by 582
Phase-functioned neural networks for character control
Holden, D., Komura, T., & Saito, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073663 · Cited by 546
peng (2017) · doi:10.1145/3072959.3073602 · Cited by 502
Meta Learning Shared HierarchiesPreprint
Frans, K., Ho, J., Chen, X., Abbeel, P., & Schulman, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09767 · Cited by 297
Neural state machine for character-scene interactions
Starke, S., Zhang, H., Komura, T., & Saito, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356505 · Cited by 290
Mode-adaptive neural networks for quadruped motion control
Zhang, H., Starke, S., Komura, T., & Saito, J. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201366 · Cited by 277
Learning symmetric and low-energy locomotion
Yu, W., Turk, G., & Liu, C. K. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201397 · Cited by 225
Near-optimal character animation with continuous control
Treuille, A., Lee, Y., & Popović, Z. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276386 · Cited by 207
Go-Explore: a New Approach for Hard-Exploration Problems
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1901.10995 · Cited by 205
DReCon: data-driven responsive control of physics-based characters
Bergamin, K., Clavet, S., Holden, D., & Forbes, J. R. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356536 · Cited by 204
Scalable muscle-actuated human simulation and control
Lee, S., Park, M., Lee, K., & Lee, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322972 · Cited by 203
Motion graphs++: a compact generative model for semantic motion analysis and synthesis
Min, J., & Chai, J. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366172 · Cited by 197
Ha, D., & Schmidhuber, J. (2018) · Zenodo · doi:10.5281/zenodo.1207631 · Cited by 187
MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics
Yan, X., Rastogi, A., Villegas, R., Sunkavalli, K., Shechtman, E., Hadap, S., Yumer, E., & Lee, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_17 · Cited by 183
Continuous character control with low-dimensional embeddings
Levine, S., Wang, J. M., Haraux, A., Popović, Z., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185524 · Cited by 170
A Recurrent Variational Autoencoder for Human Motion Synthesis
Habibie, I., Holden, D., Schwarz, J., Yearsley, J., & Komura, T. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.119 · Cited by 162
Learning predict-and-simulate policies from unorganized human motion data
Park, S., Ryu, H.-S., Lee, S., Lee, S., & Lee, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356501 · Cited by 159
Interactive character animation by learning multi-objective control
Lee, K., Lee, S., & Lee, J. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275071 · Cited by 117
Motion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866160 · Cited by 96
Learning body shape variation in physics-based characters
Won, J., & Lee, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356499 · Cited by 95
Real Time Animation of Virtual Humans: A Trade‐off Between Naturalness and Control
van Welbergen, H., van Basten, B. J. H., Egges, A., Ruttkay, Z. M., & Overmars, M. H. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2010.01822.x · Cited by 93
Motion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866160 · Cited by 85
Synthesis of biologically realistic human motion using joint torque actuation
Jiang, Y., Wouwe, T. V., Groote, F. D., & Liu, C. K. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322966 · Cited by 84
Combining Recurrent Neural Networks and Adversarial Training for Human Motion Synthesis and Control
Wang, Z., Chai, J., & Xia, S. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2938520 · Cited by 83
Precomputing avatar behavior from human motion data
Lee, J., & Lee, K. H. (2005) · Graphical Models · doi:10.1016/j.gmod.2005.03.004 · Cited by 79
On Learning Symmetric Locomotion
Abdolhosseini, F., Ling, H. Y., Xie, Z., Peng, X. B., & van de Panne, M. (2019) · Motion in Games · doi:10.1145/3359566.3360070 · Cited by 58
Self-citationReal Time Planning for Parameterized Human Motion
Lo, W., & Zwicker, M. (2008) · BORIS (University Library Bern) · Cited by 52
A Deep Learning Framework for Character Motion Synthesis and Editing
Holden, D., Saito, J., & Komura, T. (2023) · ACM eBooks · doi:10.1145/3596711.3596789 · Cited by 39
Augmenting sampling based controllers with machine learning
Rajamäki, J., & Hämäläinen, P. (2017) · ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) · doi:10.1145/3099564.3099579 · Cited by 23
Cited by
AMP: adversarial motion priors for stylized physics-based character control
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 396
Executing your Commands via Motion Diffusion in Latent Space
Chen, X., Jiang, B., Liu, W., Huang, Z., Fu, B., Chen, T., & Yu, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01726 · Cited by 356
Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion
Rempe, D., Luo, Z., Peng, X. B., Yuan, Y., Kitani, K., Kreis, K., Fidler, S., & Litany, O. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01322 · Cited by 97
Li, T., Won, J., Clegg, A., Kim, J., Rai, A., & Ha, S. (2023) · SIGGRAPH Asia 2023 Conference Papers · doi:10.1145/3610548.3618255 · Cited by 18
RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assets
Liu, I., Xu, Z., Yifan, W., Tan, H., Xu, Z., Wang, X., Su, H., & Shi, Z. (2025) · ACM Transactions on Graphics · doi:10.1145/3731149 · Cited by 12
“MotionVAEs [Ling et al. 2020] uses autoregressive conditional variational autoencoders to learn a latent action space for human movement generation and control.”
Metadata
- Authors
- Ling, H. Y., Zinno, F., Cheng, G., & Van De Panne, M.
- Venue
- ACM Transactions on Graphics
- Published
- 2020-08-12
- Volume
- 39
- Issue
- 4
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W3048550213
- Cited by
- 253
- References
- 42
- FWCI
- 16.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.