Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 223

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

DeepGait: Planning and Control of Quadrupedal Gaits Using Deep Reinforcement Learning

Open access
Tsounis, Vassilios, Alge, Mitja, Lee, Joonho, Farshidian, Farbod, Hutter, Marco · 2020 · IEEE Robotics and Automation Letters

Abstract

This letter addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the capability to generalize well to unforeseen situations. In this work, we propose a novel technique for training neural-network policies for terrain-aware locomotion, which combines state-of-the-art methods for model-based motion planning and reinforcement learning. Our approach is centered on formulating Markov decision processes using the evaluation of dynamic feasibility criteria in place of physical simulation. We thus employ policy-gradient methods to independently train policies which respectively plan and execute foothold and base motions in 3D environments using both proprioceptive and exteroceptive measurements. We apply our method within a challenging suite of simulated terrain scenarios which contain features such as narrow bridges, gaps and stepping-stones, and train policies which succeed in locomoting effectively in all cases.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/lra.2020.2979660

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Proximal Policy Optimization Algorithms

    Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625

  • Learning agile and dynamic motor skills for legged robots

    Hwangbo, J., Lee, J., Dosovitskiy, A., Bellicoso, D., Tsounis, V., Koltun, V., & Hutter, M. (2019) · Science Robotics · doi:10.1126/scirobotics.aau5872 · Cited by 1,482 · cited 1×

    “s generated by a motion planner. Reinforcement Learning: Renewed interest in using DRL to solve continuous control problems has resulted in the application of such methods to robotic locomotion, [6]. [9] demonstrated that blind locomotion controllers could be transferred to real systems by incorporating actuator dynam…”
    MethodSelf-citation
  • ANYmal - a highly mobile and dynamic quadrupedal robot

    Hutter, M., Gehring, C., Jud, D., Lauber, A., Bellicoso, C. D., Tsounis, V., Hwangbo, J., Bodie, K., Fankhauser, P., Bloesch, M., et al. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7758092 · Cited by 969 · cited 3×

    “This work was supported in part by Intel Labs, in part by the Swiss National Science Foundation (SNSF) through Projects 166232 and 188596, in part by the National Centre of Competence in Research Robotics (NCCR Robotics), in part by the European Union’s Horizon 2020 research and innovation program under Grant Agreemen…”
    BackgroundInfluentialSelf-citation
  • Emergence of Locomotion Behaviours in Rich Environments

    Heess, N., TB, D., Sriram, S., Lemmon, J., Merel, J., Wayne, G., Tassa, Y., Erez, T., Wang, Z., Eslami, S. M. A., et al. (2017) · arXiv · doi:10.48550/arxiv.1707.02286 · Cited by 657 · cited 7×

    “As physical simulation incurs a high computational cost for use with DRL, our method reduces sample-complexity for training the gait planner by using a transition feasibility criteria realized as convex LP to formulate the transition dynamics of an MDP.”
    MethodInfluential
  • Untitled work

    peng (2017) · doi:10.1145/3072959.3073602 · Cited by 502 · cited 3×

    “Others, have employed Deep Reinforcement Learning (DRL) [12], [13] for realizing end-to-end terrain-aware locomotion.”
    BackgroundMethod
  • Learning to Walk Via Deep Reinforcement Learning

    Haarnoja, T., Ha, S., Zhou, A., Tan, J., Tucker, G., & Levine, S. (2019) · Robotics: Science and Systems XV · doi:10.15607/rss.2019.xv.011 · Cited by 430

  • Per-Contact Iteration Method for Solving Contact Dynamics

    Hwangbo, J., Lee, J., & Hutter, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2792536 · Cited by 243 · cited 1×

    “We realized the MDP environment for the GP using an own implementation of CROC in C++, while for the MDP environment of the GC we used the RaiSim [18] multi-body physics engine.”
    MethodSelf-citation

Cited by

See all 223

Metadata

Authors
Tsounis, V., Alge, M., Lee, J., Farshidian, F., & Hutter, M.
Venue
IEEE Robotics and Automation Letters
Published
2020-04
Volume
5
Issue
2
Pages
3699-3706
ISSN
  • 2377-3766 (ISSN-L)
  • 2377-3774
OpenAlex
W2974120010
Cited by
223
References
7
FWCI
9.81
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.