Cited by 735Robotic Locomotion and ControlReinforcement Learning in RoboticsProsthetics and Rehabilitation Robotics

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

Open access
Tan, Jie, Zhang, Tingnan, Coumans, Erwin, Iscen, Atil, Bai, Yunfei, Hafner, Danijar, Bohez, Steven, Vanhoucke, Vincent·2018·Robotics: Science and Systems XIV

Abstract

Designing agile locomotion for quadruped robots often requires extensive expertise and tedious manual tuning.In this paper, we present a system to automate this process by leveraging deep reinforcement learning techniques.Our system can learn quadruped locomotion from scratch using simple reward signals.In addition, users can provide an open loop reference to guide the learning process when more control over the learned gait is needed.The control policies are learned in a physics simulator and then deployed on real robots.In robotics, policies trained in simulation often do not transfer to the real world.We narrow this reality gap by improving the physics simulator and learning robust policies.We improve the simulation using system identification, developing an accurate actuator model and simulating latency.We learn robust controllers by randomizing the physical environments, adding perturbations and designing a compact observation space.We evaluate our system on two agile locomotion gaits: trotting and galloping.After learning in simulation, a quadruped robot can successfully perform both gaits in the real world.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.15607/rss.2018.xiv.010

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These artifacts limit the applicability of generative videos in physics-sensitive domains such as robotics, autonomous driving, simulation-based design, and scientific visualization.

    “These artifacts limit the applicability of generative videos in physics-sensitive domains such as robotics [25,26], autonomous driving [27], simulationbased design, and scientific visualization [28].”

    From PhyStruct-Video: Structured Physics State Spaces for Physically Consistent Video Generation (2025) · cites this paper as [26]

    In “Narrowing the Reality Gap” (page unavailable), the paper reports that controllers trained in simulations with substantial model discrepancies performed poorly on real robots. That supports the concern that inaccurate physics can limit robotics applications, but the paper does not address artifacts in generative videos. (LLM, conf=0.80)

    Experimental — accuracy not yet measured
  • Policies trained on videos generated by PhyStruct-Video exhibit smaller sim-to-real gaps in MuJoCo and CARLA-like tasks.

    “We further show that policies trained on videos generated by PhyStruct-Video exhibit smaller sim-to-real gaps in MuJoCo and CARLA-like tasks [42,25,27,26].”

    From PhyStruct-Video: Structured Physics State Spaces for Physically Consistent Video Generation (2025) · cites this paper as [26]

    The Evaluation and Discussion section describes policies learned in simulated Bullet environments for Minitaur locomotion, then deployed on a real robot. The passages on narrowing the reality gap discuss simulation fidelity, randomization, and observation space; neither they nor searches for PhyStruct-Video, generated videos, MuJoCo, and CARLA-like tasks address the specific claim. (LLM, conf=0.76)

    Experimental — accuracy not yet measured
  • Application of reinforcement learning to legged locomotion has largely been confined to laboratory environments and conditions.

    “However, application of RL to legged locomotion has largely been confined to laboratory environments and conditions.”

    From Learning quadrupedal locomotion over challenging terrain (2020) · cites this paper as [16]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Xue Bin Peng, Glen Berseth, KangKang Yin, and Michiel van de Panne. DeepLoco: Dynamic locomotion skills using hierarchical deep reinforcement learning. ACM Transactions on Graphics (Proc. SIGGRAPH 2017), 36 (4), 2017.
  2. Rico Möckel, N. Perov Yura, Anh The Nguyen, Massimo Vespignani, Stephane Bonardi, Soha Pouya, Alexander Spröwitz, Jesse van den Kieboom, Frederic Wilhelm, and Auke Jan Ijspeert. Gait optimization for roombots modular robots -matching simulation and reality. In Proceedings of the 2013 IEEE/RSJ International Con- ference on Intelligent Robots and Systems, pages 3265- 3272, Tokyo, 2013. IEEE.

Cited by

Sorted by citations

Authors
Tan, J., Zhang, T., Coumans, E., Iscen, A., Bai, Y., Hafner, D., Bohez, S., & Vanhoucke, V.
Affiliations
Google DeepMind (United Kingdom) (GB)
Venue
Robotics: Science and Systems XIV
Published
2018-06-26
OpenAlex
W2963184939
Cited by
735
References
58
Citations by year
2026: 50 · 2025: 98 · 2024: 102 · 2023: 86 · 2022: 101 · 2021: 116 · 2020: 104 · 2019: 68 · 2018: 9 · 2017: 1
FWCI
162.81
Type
conference paper
Language
en
Open access
Locations
  • Robotics: Science and Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Robotic Locomotion and Control
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Biomedical Engineering › Prosthetics and Rehabilitation Robotics
Keywords
quadruped robot, agile locomotion, sim-to-real transfer, deep reinforcement learning, system identification, actuator modeling, robust control, trotting, galloping, gait learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review