Cited by 111Human Motion and AnimationReinforcement Learning in RoboticsComputer Graphics and Visualization Techniques

Learning to schedule control fragments for physics-based characters using deep q-learning

Liu, Libin, Hodgins, Jessica·2017·ACM Transactions on Graphics

Abstract

Given a robust control system, physical simulation offers the potential for interactive human characters that move in realistic and responsive ways. In this article, we describe how to learn a scheduling scheme that reorders short control fragments as necessary at runtime to create a control system that can respond to disturbances and allows steering and other user interactions. These schedulers provide robust control of a wide range of highly dynamic behaviors, including walking on a ball, balancing on a bongo board, skateboarding, running, push-recovery, and breakdancing. We show that moderate-sized Q-networks can model the schedulers for these control tasks effectively and that those schedulers can be efficiently learned by the deep Q-learning algorithm.

Integrity signals

Registry

Crossref · 10.1145/3083723

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Liu, L., & Hodgins, J.
Affiliations
  • Walt Disney (United States) (US)
  • Carnegie Mellon University (US)
Venue
ACM Transactions on Graphics
Published
2017-06-27
Volume
36
Issue
3
Pages
1-14
ISSN
  • 0730-0301 (ISSN-L)
  • 1557-7368
OpenAlex
W4250901985
Cited by
49
References
41
Citations by year
2025: 4 · 2024: 5 · 2023: 4 · 2022: 2 · 2021: 6 · 2020: 5 · 2019: 7 · 2018: 16
FWCI
4.81
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Graphics (publishedVersion)
Funders
University of Pennsylvania
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Human Motion and Animation
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
Keywords
physics-based animation, deep Q-learning, Q-network, robust control, dynamic locomotion, balancing, skateboarding, breakdancing, push recovery

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review