The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Mode-adaptive neural networks for quadruped motion control
Open accessAbstract
Quadruped motion includes a wide variation of gaits such as walk, pace, trot and canter, and actions such as jumping, sitting, turning and idling. Applying existing data-driven character control frameworks to such data requires a significant amount of data preprocessing such as motion labeling and alignment. In this paper, we propose a novel neural network architecture called Mode-Adaptive Neural Networks for controlling quadruped characters. The system is composed of the motion prediction network and the gating network. At each frame, the motion prediction network computes the character state in the current frame given the state in the previous frame and the user-provided control signals. The gating network dynamically updates the weights of the motion prediction network by selecting and blending what we call the expert weights, each of which specializes in a particular movement. Due to the increased flexibility, the system can learn consistent expert weights across a wide range of non-periodic/periodic actions, from unstructured motion capture data, in an end-to-end fashion. In addition, the users are released from performing complex labeling of phases in different gaits. We show that this architecture is suitable for encoding the multi-modality of quadruped locomotion and synthesizing responsive motion in real-time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Fixing Weight Decay Regularization in Adam
Loshchilov, I., & Hutter, F. (2018) · Cited by 1,297
(2021) · Computer Graphics Forum · doi:10.1111/(issn)1467-8659 · Cited by 1,230
Generalizing motion edits with Gaussian processes
Ikemoto, L., Arikan, O., & Forsyth, D. (2009) · ACM Transactions on Graphics · doi:10.1145/1477926.1477927 · Cited by 1,214
Kovar, L., Gleicher, M., & Pighin, F. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401202 · Cited by 1,052
Gaussian Process Dynamical Models for Human Motion
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1167 · Cited by 1,020
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv · doi:10.48550/arxiv.1701.06538 · Cited by 933
Interactive control of avatars animated with human motion data
Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., & Pollard, N. S. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566607 · Cited by 864
Verbs and adverbs: multidimensional motion interpolation
Rose, C., Cohen, M. F., & Bodenheimer, B. (1998) · IEEE Computer Graphics and Applications · doi:10.1109/38.708559 · Cited by 730
A deep learning framework for character motion synthesis and editing
Holden, D., Saito, J., & Komura, T. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925975 · Cited by 655
Self-citationStyle-based inverse kinematics
Grochow, K., Martin, S. L., Hertzmann, A., & Popović, Z. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015755 · Cited by 642
Twenty Years of Mixture of Experts
Yuksel, S. E., Wilson, J. N., & Gader, P. D. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2200299 · Cited by 606
Learning multiple visual domains with residual adapters
Rebuffi, S.-A., Bilen, H., & Vedaldi, A. (2017) · arXiv · doi:10.48550/arxiv.1705.08045 · Cited by 605 · cited 1×
“It will be interesting to see if neural domain transfer type of approaches based on factorization [Bertinetto et al. 2016] or Resnets [Rebuffi et al. 2017] can be applied such that a wide variation of gaits and movements can be created from a rich set of locomotion of one animal and a small set of…”
BackgroundKovar, L., Gleicher, M., & Pighin, F. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566605 · Cited by 597
Multi-level Factorisation Net for Person Re-identification
Chang, X., Hospedales, T. M., & Xiang, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00225 · Cited by 550
Phase-functioned neural networks for character control
Holden, D., Komura, T., & Saito, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073663 · Cited by 546
Self-citationInteractive motion generation from examples
Arikan, O., & Forsyth, D. A. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566606 · Cited by 539
Automated extraction and parameterization of motions in large data sets
Kovar, L., & Gleicher, M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015760 · Cited by 483
Interactive control of avatars animated with human motion data
Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., & Pollard, N. S. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566607 · Cited by 467
Learning Factored Representations in a Deep Mixture of ExpertsPreprint
Eigen, D., Ranzato, M., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4314 · Cited by 417
Interactive motion generation from examples
Arikan, O., & Forsyth, D. A. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566606 · Cited by 391
Factored conditional restricted Boltzmann Machines for modeling motion style
Taylor, G. W., & Hinton, G. E. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553505 · Cited by 358
Performance animation from low-dimensional control signals
Chai, J., & Hodgins, J. K. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073248 · Cited by 342
Learning physics-based motion style with nonlinear inverse optimization
Liu, C. K., Hertzmann, A., & Popović, Z. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073314 · Cited by 341
SIMBICON: simple biped locomotion control
Yin, K., Loken, K., & van de Panne, M. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276509 · Cited by 337
SIMBICON: simple biped locomotion control
Yin, K., Loken, K., & van de Panne, M. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276509 · Cited by 328
HP-GAN: Probabilistic 3D Human Motion Prediction via GAN
Barsoum, E., Kender, J., & Liu, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00191 · Cited by 322
Style translation for human motion
Hsu, E., Pulli, K., & Popović, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073315 · Cited by 305
Animation of dynamic legged locomotion
Raibert, M. H., & Hodgins, J. K. (1991) · Proceedings of the 18th annual conference on Computer graphics and interactive techniques · doi:10.1145/122718.122755 · Cited by 292
Learning motion manifolds with convolutional autoencoders
Holden, D., Saito, J., Komura, T., & Joyce, T. (2015) · SIGGRAPH Asia 2015 Technical Briefs · doi:10.1145/2820903.2820918 · Cited by 263
Self-citationLearning feed-forward one-shot learners
Bertinetto, L., Henriques, J. F., Valmadre, J., Torr, P. H. S., & Vedaldi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05233 · Cited by 226
Learning human behaviors from motion capture by adversarial imitationPreprint
Merel, J., Tassa, Y., Tb, D., Srinivasan, S., Lemmon, J., Wang, Z., Wayne, G., & Heess, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.02201 · Cited by 225
Realtime style transfer for unlabeled heterogeneous human motion
Xia, S., Wang, C., Chai, J., & Hodgins, J. (2015) · ACM Transactions on Graphics · doi:10.1145/2766999 · Cited by 201
Terrain-adaptive locomotion skills using deep reinforcement learning
Peng, X. B., Berseth, G., & van de Panne, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925881 · Cited by 200
Geostatistical motion interpolation
Mukai, T., & Kuriyama, S. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073313 · Cited by 199
Synthesis of complex dynamic character motion from simple animations
Liu, C. K., & Popović, Z. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566596 · Cited by 199
Motion reconstruction using sparse accelerometer data
Tautges, J., Zinke, A., Krüger, B., Baumann, J., Weber, A., Helten, T., Müller, M., Seidel, H.-P., & Eberhardt, B. (2011) · ACM Transactions on Graphics · doi:10.1145/1966394.1966397 · Cited by 197
Motion graphs++: a compact generative model for semantic motion analysis and synthesis
Min, J., & Chai, J. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366172 · Cited by 197
Real-time motion retargeting to highly varied user-created morphologies
Hecker, C., Raabe, B., Enslow, R. W., DeWeese, J., Maynard, J., & van Prooijen, K. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360626 · Cited by 182
Continuous character control with low-dimensional embeddings
Levine, S., Wang, J. M., Haraux, A., Popović, Z., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185524 · Cited by 170
Behavior planning for character animation
Lau, M., & Kuffner, J. J. (2005) · Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation · doi:10.1145/1073368.1073408 · Cited by 158
Two Distributed-State Models For Generating High-Dimensional Time Series
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021035 · Cited by 151
Optimal gait and form for animal locomotion
Wampler, K., & Popović, Z. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531366 · Cited by 150
Locomotion skills for simulated quadrupeds
Coros, S., Karpathy, A., Jones, B., Revéret, L., & van de Panne, M. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964954 · Cited by 125
Recurrent Network Models for Human DynamicsPreprint
Fragkiadaki, K., Levine, S., Felsen, P., & Malik, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00271 · Cited by 125
Synthesis of detailed hand manipulations using contact sampling
Ye, Y., & Liu, C. K. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185537 · Cited by 121
Locomotion skills for simulated quadrupeds
Coros, S., Karpathy, A., Jones, B., Revéret, L., & van de Panne, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964954 · Cited by 120
Trajectory Optimization for Full-Body Movements with Complex Contacts
Borno, M. A., de Lasa, M., & Hertzmann, A. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.325 · Cited by 119
Learning to Schedule Control Fragments for Physics-Based Characters Using Deep Q-Learning
Liu, L., & Hodgins, J. K. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3083723 · Cited by 116
Synthesis of complex dynamic character motion from simple animations
Liu, C. K., & Popović, Z. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566596 · Cited by 111
Motion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866160 · Cited by 96
Motion fields for interactive character locomotion
Lee, Y.-J., Wampler, K., Bernstein, G., Popović, J., & Popović, Z. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866160 · Cited by 85
Dynamic terrain traversal skills using reinforcement learning
Peng, X. B., Berseth, G., & van de Panne, M. (2015) · ACM Transactions on Graphics · doi:10.1145/2766910 · Cited by 80
Learning to schedule control fragments for physics-based characters using deep q-learning
Liu, L., & Hodgins, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3083723 · Cited by 49
Modal Locomotion: Animating Virtual Characters with Natural Vibrations
Kry, P. G., Revéret, L., Fauré, F., et al. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01368.x · Cited by 45
Generalizing locomotion style to new animals with inverse optimal regression
Wampler, K., Popović, Z., & Popović, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601192 · Cited by 42
Auto-Conditioned LSTM Network for Extended Complex Human Motion Synthesis
Li, Z., Zhou, Y., Xiao, S., He, C., & Li, H. (2017) · Cited by 32
Procedural locomotion of multilegged characters in dynamic environments
Karim, A. A., Gaudin, T., Meyer, A., Buendia, A., & Bouakaz, S. (2012) · Computer Animation and Virtual Worlds · doi:10.1002/cav.1467 · Cited by 13
Cited by
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++
Li, R., Yang, S., Ross, D. A., & Kanazawa, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01315 · Cited by 553
“Phase-functioned neural networks and it’s variations [94, 33, 73, 74] address this issue via conditioning the network weights on phase, however, they do not scale well to represent a wide variety of motion.”
BackgroundAMP: adversarial motion priors for stylized physics-based character control
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 396
Learning Agile Robotic Locomotion Skills by Imitating Animals
Bin Peng, X., Coumans, E., Zhang, T., Lee, T.-W., Tan, J., & Levine, S. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.064 · Cited by 357
Neural state machine for character-scene interactions
Starke, S., Zhang, H., Komura, T., & Saito, J. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356505 · Cited by 290
Self-citationHarvey, F. G., Yurick, M., Nowrouzezahrai, D., & Pal, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392480 · Cited by 266
Metadata
- Authors
- Zhang, H., Starke, S., Komura, T., & Saito, J.
- Venue
- ACM Transactions on Graphics
- Published
- 2018-07-30
- Volume
- 37
- Issue
- 4
- Pages
- 1-11
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2801567109
- Cited by
- 277
- References
- 61
- FWCI
- 17.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.