The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Learning robust perceptive locomotion for quadrupedal robots in the wild
Open accessAbstract
Legged robots that can operate autonomously in remote and hazardous environments will greatly increase opportunities for exploration into underexplored areas. Exteroceptive perception is crucial for fast and energy-efficient locomotion: Perceiving the terrain before making contact with it enables planning and adaptation of the gait ahead of time to maintain speed and stability. However, using exteroceptive perception robustly for locomotion has remained a grand challenge in robotics. Snow, vegetation, and water visually appear as obstacles on which the robot cannot step or are missing altogether due to high reflectance. In addition, depth perception can degrade due to difficult lighting, dust, fog, reflective or transparent surfaces, sensor occlusion, and more. For this reason, the most robust and general solutions to legged locomotion to date rely solely on proprioception. This severely limits locomotion speed because the robot has to physically feel out the terrain before adapting its gait accordingly. Here, we present a robust and general solution to integrating exteroceptive and proprioceptive perception for legged locomotion. We leverage an attention-based recurrent encoder that integrates proprioceptive and exteroceptive input. The encoder is trained end to end and learns to seamlessly combine the different perception modalities without resorting to heuristics. The result is a legged locomotion controller with high robustness and speed. The controller was tested in a variety of challenging natural and urban environments over multiple seasons and completed an hour-long hike in the Alps in the time recommended for human hikers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
BigDog, the Rough-Terrain Quadruped Robot
Raibert, M., Blankespoor, K., Nelson, G., & Playter, R. (2008) · IFAC Proceedings Volumes · doi:10.3182/20080706-5-kr-1001.01833 · Cited by 1,495
Learning agile and dynamic motor skills for legged robots
Hwangbo, J., Lee, J., Dosovitskiy, A., Bellicoso, D., Tsounis, V., Koltun, V., & Hutter, M. (2019) · Science Robotics · doi:10.1126/scirobotics.aau5872 · Cited by 1,482
Self-citationLearning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Science Robotics · doi:10.1126/scirobotics.abc5986 · Cited by 1,156
Self-citationDeepMimic: example-guided deep reinforcement learning of physics-based character skills
Peng, X. B., Abbeel, P., Levine, S., & van de Panne, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201311 · Cited by 880
Learning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000448343 · Cited by 752
Self-citationSim-to-Real: Learning Agile Locomotion For Quadruped Robots
Tan, J., Zhang, T., Coumans, E., Iscen, A., Bai, Y., Hafner, D., Bohez, S., & Vanhoucke, V. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.010 · Cited by 735
Cited by
Multi-environment robotic transitions through adaptive morphogenesis
Baines, R., Patiballa, S. K., Booth, J., Ramirez, L., Sipple, T., Garcia, A., Fish, F., & Kramer-Bottiglio, R. (2022) · Nature · doi:10.1038/s41586-022-05188-w · Cited by 324
Teleoperation of Humanoid Robots: A Survey
Darvish, K., Penco, L., Ramos, J., Cisneros, R., Pratt, J., Yoshida, E., Ivaldi, S., & Pucci, D. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3236952 · Cited by 278
Perceptive Locomotion Through Nonlinear Model-Predictive Control
Grandia, R., Jenelten, F., Yang, S., Farshidian, F., & Hutter, M. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3275384 · Cited by 265
Self-citationANYmal parkour: Learning agile navigation for quadrupedal robots
Hoeller, D., Rudin, N., Sako, D., & Hutter, M. (2024) · Science Robotics · doi:10.1126/scirobotics.adi7566 · Cited by 263
Self-citationNavigating to objects in the real world
Gervet, T., Chintala, S., Batra, D., Malik, J., & Chaplot, D. S. (2023) · Science Robotics · doi:10.1126/scirobotics.adf6991 · Cited by 125
CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion
Bellegarda, G., & Ijspeert, A. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3218167 · Cited by 125
Scientific exploration of challenging planetary analog environments with a team of legged robots
Arm, P., Waibel, G., Preisig, J., Tuna, T., Zhou, R., Bickel, V., Ligeza, G., Miki, T., Kehl, F., Kolvenbach, H., et al. (2023) · Science Robotics · doi:10.1126/scirobotics.ade9548 · Cited by 124
Self-citationThe neuromechanics of animal locomotion: From biology to robotics and back
Ramdya, P., & Ijspeert, A. J. (2023) · Science Robotics · doi:10.1126/scirobotics.adg0279 · Cited by 92
DayDreamer: World Models for Physical Robot Learning
Wu, P., Escontrela, A., Hafner, D., Goldberg, K., & Abbeel, P. (2022) · arXiv · doi:10.48550/arxiv.2206.14176 · Cited by 76
“…Lee et al., 2020; Irpan et al., 2020; Rudin et al., 2021; Kumar et al., 2021; Siekmann et al., 2021; Smith et al., 2021; Escontrela et al., 2022; Miki et al., 2022), leverage 0 40 80 120 Minutes 0.1 0.3 0.5 0.7 0.9 A v g D i s t t o G o a l Figure 7: Sphero Navigation This task requires the…”
BackgroundInfluentialScaling Up and Distilling Down: Language-Guided Robot Skill Acquisition
Ha, H., Florence, P., & Song, S. (2023) · arXiv · doi:10.48550/arxiv.2307.14535 · Cited by 24
“We then distill only successful trajectories into an observable-information [41–43] policy, allowing the distilled policy to improve upon its LLM data collection policy’s performance.”
MethodTC-driver: A trajectory conditioned reinforcement learning approach to zero-shot autonomous racing
Ghignone, E., Baumann, N., & Magno, M. (2024) · IEEE Transactions on Field Robotics · doi:10.1109/tfr.2024.3499912 · Cited by 10
Towards Embodiment Scaling Laws in Robot Locomotion
Ai, B., Dai, L., Bohlinger, N., Li, D., Mu, T., Wu, Z., Fay, K., Christensen, H. I., Peters, J., & Su, H. (2025) · arXiv · doi:10.48550/arxiv.2505.05753
“The combination of scalable on-policy RL algorithms, such as Proximal Policy Optimization (PPO) [81], with fast and highly parallelizable simulators has enabled the training of powerful locomotion policies for quadruped [11, 16, 19, 64, 67, 90, 108] and humanoid robots [52, 55, 78, 86, 109].”
Metadata
- Authors
- Miki, T., Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M.
- Venue
- Science Robotics
- Published
- 2022-01-26
- Volume
- 7
- Issue
- 62
- Pages
- eabk2822-eabk2822
- ISSN
- 2470-9476 (ISSN-L)
- OpenAlex
- W4205430897
- Cited by
- 813
- References
- 39
- FWCI
- 44.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.