The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Phase-functioned neural networks for character control
Open accessAbstract
We present a real-time character control mechanism using a novel neural network architecture called a Phase-Functioned Neural Network. In this network structure, the weights are computed via a cyclic function which uses the phase as an input. Along with the phase, our system takes as input user controls, the previous state of the character, the geometry of the scene, and automatically produces high quality motions that achieve the desired user control. The entire network is trained in an end-to-end fashion on a large dataset composed of locomotion such as walking, running, jumping, and climbing movements fitted into virtual environments. Our system can therefore automatically produce motions where the character adapts to different geometric environments such as walking and running over rough terrain, climbing over large rocks, jumping over obstacles, and crouching under low ceilings. Our network architecture produces higher quality results than time-series autoregressive models such as LSTMs as it deals explicitly with the latent variable of motion relating to the phase. Once trained, our system is also extremely fast and compact, requiring only milliseconds of execution time and a few megabytes of memory, even when trained on gigabytes of motion data. Our work is most appropriate for controlling characters in interactive scenes such as computer games and virtual reality systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · cited 2×
“Here h is the number of hidden units used on each layer which in our work is set to 512 and the activation function used is the exponential rectified linear function [Clevert et al. 2015] defined by”
MethodGaussian Process Dynamical Models for Human Motion
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1167 · Cited by 1,020
Interactive control of avatars animated with human motion data
Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., & Pollard, N. S. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566607 · Cited by 864
Recurrent Network Models for Human Dynamics
Fragkiadaki, K., Levine, S., Felsen, P., & Malik, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.494 · Cited by 860
Verbs and adverbs: multidimensional motion interpolation
Rose, C., Cohen, M. F., & Bodenheimer, B. (1998) · IEEE Computer Graphics and Applications · doi:10.1109/38.708559 · Cited by 730
A deep learning framework for character motion synthesis and editing
Holden, D., Saito, J., & Komura, T. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925975 · Cited by 655
Self-citationDeep Convolutional Inverse Graphics Network
Kulkarni, T. D., Whitney, W., Kohli, P., & Tenenbaum, J. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03167 · Cited by 653
Style-based inverse kinematics
Grochow, K., Martin, S. L., Hertzmann, A., & Popović, Z. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015755 · Cited by 642
Practical Parameterization of Rotations Using the Exponential Map
Grassia, F. S. (1998) · Journal of Graphics Tools · doi:10.1080/10867651.1998.10487493 · Cited by 495
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Factored conditional restricted Boltzmann Machines for modeling motion style
Taylor, G. W., & Hinton, G. E. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553505 · Cited by 358
Performance animation from low-dimensional control signals
Chai, J., & Hodgins, J. K. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073248 · Cited by 342
Learning motion manifolds with convolutional autoencoders
Holden, D., Saito, J., Komura, T., & Joyce, T. (2015) · SIGGRAPH Asia 2015 Technical Briefs · doi:10.1145/2820903.2820918 · Cited by 263
Self-citationBayesian Reconstruction of 3D Human Motion from Single-Camera Video
Howe, N. R., Leventon, M. E., & Freeman, W. T. (1999) · Smith ScholarWorks (Smith College) · Cited by 255
From 3D scene geometry to human workspace
Gupta, A., Satkin, S., Efros, A. A., & Hebert, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995448 · Cited by 224
Grabner, H., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995327 · Cited by 219
On-line locomotion generation based on motion blending
Park, S. I., Shin, H. J., & Shin, S. Y. (2002) · Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation · doi:10.1145/545261.545279 · Cited by 201
Realtime style transfer for unlabeled heterogeneous human motion
Xia, S., Wang, C., Chai, J., & Hodgins, J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766999 · Cited by 201
Terrain-adaptive locomotion skills using deep reinforcement learning
Peng, X. B., Berseth, G., & van de Panne, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925881 · Cited by 200
Geostatistical motion interpolation
Mukai, T., & Kuriyama, S. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073313 · Cited by 199
Motion reconstruction using sparse accelerometer data
Tautges, J., Zinke, A., Krüger, B., Baumann, J., Weber, A., Helten, T., Müller, M., Seidel, H.-P., & Eberhardt, B. (2011) · ACM Transactions on Graphics · doi:10.1145/1966394.1966397 · Cited by 197
Motion graphs++: a compact generative model for semantic motion analysis and synthesis
Min, J., & Chai, J. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366172 · Cited by 197
Real‐Time Shape Editing using Radial Basis Functions
Botsch, M., & Kobbelt, L. (2005) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2005.00886.x · Cited by 185
Continuous character control with low-dimensional embeddings
Levine, S., Wang, J. M., Haraux, A., Popović, Z., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185524 · Cited by 170
Precomputing avatar behavior from human motion data
Lee, J., & Lee, K. H. (2004) · Computer animation and simulation · doi:10.1145/1028523.1028535 · Cited by 168
Sampling-based contact-rich motion control
Liu, L., Yin, K., van de Panne, M., Shao, T., & Xu, W. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778865 · Cited by 161
Behavior planning for character animation
Lau, M., & Kuffner, J. J. (2005) · Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation · doi:10.1145/1073368.1073408 · Cited by 158
Guided Learning of Control Graphs for Physics-Based Characters
Liu, L., van de Panne, M., & Yin, K. (2016) · ACM Transactions on Graphics · doi:10.1145/2893476 · Cited by 146
Savva, M., Chang, A. X., Hanrahan, P., Fisher, M., & Nießner, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925867 · Cited by 131
Memisevic, R. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.53 · Cited by 114
Constraint-based motion optimization using a statistical dynamic model
Chai, J., & Hodgins, J. K. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276387 · Cited by 114
Shape2Pose: human-centric shape analysis
Kim, V. G., Chaudhuri, S., Guibas, L., & Funkhouser, T. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601117 · Cited by 112
Relationship descriptors for interactive motion adaptation
Al-Asqhar, R. A., Komura, T., & Choi, M. G. (2013) · ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) · doi:10.1145/2485895.2485905 · Cited by 98
Self-citationMotion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866160 · Cited by 96
Motion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866160 · Cited by 85
Synthesis of constrained walking skills
Coros, S., Beaudoin, P., Yin, K. K., & van de Panne, M. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409066 · Cited by 65
Real Time Planning for Parameterized Human Motion
Lo, W., & Zwicker, M. (2008) · BORIS (University Library Bern) · Cited by 52
Savva, M., Chang, A. X., Hanrahan, P., Fisher, M., & Nießner, M. (2016) · doi:10.1145/2992138.2992147 · Cited by 12
Cited by
DeepMimic: example-guided deep reinforcement learning of physics-based character skills
Peng, X. B., Abbeel, P., Levine, S., & van de Panne, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201311 · Cited by 880
Generating Diverse and Natural 3D Human Motions from Text
Guo, C., Zou, S., Zuo, X., Wang, S., Ji, W., Li, X., & Cheng, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00509 · Cited by 575
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++
Li, R., Yang, S., Ross, D. A., & Kanazawa, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01315 · Cited by 553
“Phase-functioned neural networks and it’s variations [94, 33, 73, 74] address this issue via conditioning the network weights on phase, however, they do not scale well to represent a wide variety of motion.”
BackgroundAction-Conditioned 3D Human Motion Synthesis with Transformer VAE
Petrovich, M., Black, M. J., & Varol, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01080 · Cited by 493
AMP: adversarial motion priors for stylized physics-based character control
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 396
Metadata
- Authors
- Holden, D., Komura, T., & Saito, J.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-13
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2611706523
- Cited by
- 546
- References
- 40
- FWCI
- 29.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.