The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Perceptive Locomotion Through Nonlinear Model-Predictive Control
Open accessAbstract
Dynamic locomotion in rough terrain requires accurate foot placement, collision avoidance, and planning of the underactuated dynamics of the system. Reliably optimizing for such motions and interactions in the presence of imperfect and often incomplete perceptive information is challenging. We present a complete perception, planning, and control pipeline, which can optimize motions for all degrees of freedom of the robot in real time. To mitigate the numerical challenges posed by the terrain, a sequence of convex inequality constraints is extracted as local approximations of foothold feasibility and embedded into an online model-predictive controller. Steppability classification, plane segmentation, and a signed distance field are precomputed per elevation map to minimize the computational effort during the optimization. A combination of multiple-shooting, real-time iteration, and a filter-based line search is used to solve the formulated problem reliably and at high rate. We validate the proposed method in scenarios with gaps, slopes, and stepping stones in simulation and experimentally on the ANYmal quadruped platform, resulting in state-of-the-art dynamic climbing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5 · Cited by 9,008
SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization
Gill, P. E., Murray, W., & Saunders, M. A. (2005) · SIAM Review · doi:10.1137/s0036144504446096 · Cited by 2,834
Raibert, M. H., & Tello, E. R. (1986) · IEEE Expert · doi:10.1109/mex.1986.4307016 · Cited by 2,725
Topological structural analysis of digitized binary images by border following
Suzuki, S., & be, K. (1985) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(85)90016-7 · Cited by 2,663
Efficient RANSAC for Point‐Cloud Shape Detection
Schnabel, R., Wahl, R., & Klein, R. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01016.x · Cited by 2,106
ZERO-MOMENT POINT — THIRTY FIVE YEARS OF ITS LIFE
VUKOBRATOVIĆ, M., & BOROVAC, B. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000083 · Cited by 2,038
Model predictive control: Recent developments and future promise
Mayne, D. Q. (2014) · Automatica · doi:10.1016/j.automatica.2014.10.128 · Cited by 1,975
A Multiple Shooting Algorithm for Direct Solution of Optimal Control Problems *
Bock, H. G., & Plitt, K. J. (1984) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)61205-9 · Cited by 1,306
Learning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Science Robotics · doi:10.1126/scirobotics.abc5986 · Cited by 1,156 · cited 1×
“Learning-based controllers have recently shown the ability to generalize blind locomotion to challenging terrain with incredible robustness [12], [13], [14].”
BackgroundSelf-citationControl barrier function based quadratic programs with application to adaptive cruise control
Ames, A. D., Grizzle, J. W., & Tabuada, P. (2014) · 53rd IEEE Conference on Decision and Control · doi:10.1109/cdc.2014.7040372 · Cited by 974
ANYmal - a highly mobile and dynamic quadrupedal robot
Hutter, M., Gehring, C., Jud, D., Lauber, A., Bellicoso, C. D., Tsounis, V., Hwangbo, J., Bodie, K., Fankhauser, P., Bloesch, M., et al. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7758092 · Cited by 969 · cited 1×
“The resulting method is evaluated on the quadrupedal robot ANYmal [25] (see Fig.1)inSectionVII.”
MethodSelf-citationNonlinear programming without a penalty function
Fletcher, R., & Leyffer, S. (2002) · Mathematical Programming · doi:10.1007/s101070100244 · Cited by 874
Learning robust perceptive locomotion for quadrupedal robots in the wild
Miki, T., Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2022) · Science Robotics · doi:10.1126/scirobotics.abk2822 · Cited by 813
Self-citationCHOMP: Covariant Hamiltonian optimization for motion planning
Zucker, M., Ratliff, N., Dragan, A. D., Pivtoraiko, M., Klingensmith, M., Dellin, C. M., Bagnell, J. A., & Srinivasa, S. S. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913488805 · Cited by 758
Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-Predictive Control
Di Carlo, J., Wensing, P. M., Katz, B., Bledt, G., & Kim, S. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594448 · Cited by 758
Learning quadrupedal locomotion over challenging terrain
Lee, J., Hwangbo, J., Wellhausen, L., Koltun, V., & Hutter, M. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000448343 · Cited by 752
Self-citationSynthesis and stabilization of complex behaviors through online trajectory optimization
Tassa, Y., Erez, T., & Todorov, E. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386025 · Cited by 744
Diehl, M., Bock, H. G., Schlöder, J. P., Findeisen, R., Nagy, Z., & Allgöwer, F. (2002) · Journal of Process Control · doi:10.1016/s0959-1524(01)00023-3 · Cited by 695
Mangasarian, O. L., & Fromovitz, S. (1967) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(67)90163-1 · Cited by 622
A direct method for trajectory optimization of rigid bodies through contact
Posa, M., Cantu, C., & Tedrake, R. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364913506757 · Cited by 597 · cited 2×
“They are the workhorse for offline trajectory optimization in the work of Winkler [19], Dai [20], Mordatch [18], Posa [49], and Pardo [43].”
BackgroundMethodA Real-Time Iteration Scheme for Nonlinear Optimization in Optimal Feedback Control
Diehl, M., Bock, H. G., & Schlöder, J. P. (2005) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012902400713 · Cited by 570
Centroidal dynamics of a humanoid robot
Orin, D. E., Goswami, A., & Lee, S. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9341-4 · Cited by 565
Differential dynamic programming
Denham, W. (1971) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1971.1099760 · Cited by 530
Exponential Control Barrier Functions for enforcing high relative-degree safety-critical constraints
Nguyen, Q., & Sreenath, K. (2016) · 2016 American Control Conference (ACC) · doi:10.1109/acc.2016.7524935 · Cited by 519
Discovery of complex behaviors through contact-invariant optimization
Mordatch, I., Todorov, E., & Popović, Z. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185539 · Cited by 451
Winkler, A. W., Bellicoso, C. D., Hutter, M., & Buchli, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2798285 · Cited by 451
Self-citationWhole-body motion planning with centroidal dynamics and full kinematics
Dai, H., Valenzuela, A., & Tedrake, R. (2014) · 2014 IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2014.7041375 · Cited by 423
An auto-generated real-time iteration algorithm for nonlinear MPC in the microsecond range
Houska, B., Ferreau, H. J., & Diehl, M. (2011) · Automatica · doi:10.1016/j.automatica.2011.08.020 · Cited by 416
Optimizing two-pass connected-component labeling algorithms
Wu, K. J., Otoo, E. J., & Suzuki, K. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-008-0109-y · Cited by 297
Whole-Body Nonlinear Model Predictive Control Through Contacts for Quadrupeds
Neunert, M., Stauble, M., Giftthaler, M., Bellicoso, C. D., Carius, J., Gehring, C., Hutter, M., & Buchli, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800124 · Cited by 284
Self-citationFootstep planning on uneven terrain with mixed-integer convex optimization
Deits, R., & Tedrake, R. (2014) · 2014 IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2014.7041373 · Cited by 280
A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation
Sleiman, J.-P., Farshidian, F., Minniti, M. V., & Hutter, M. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068908 · Cited by 262
Self-citationComputing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming
Deits, R., & Tedrake, R. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-16595-0_7 · Cited by 249
A Universal Grid Map Library: Implementation and Use Case for Rough Terrain Navigation
Fankhauser, P., & Hutter, M. (2016) · Studies in Computational Intelligence · doi:10.1007/978-3-319-26054-9_5 · Cited by 246
Self-citationA whole-body control framework for humanoids operating in human environments
Sentis, L., & Khatib, O. (2006) · Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. · doi:10.1109/robot.2006.1642100 · Cited by 244
Dynamic Whole-Body Motion Generation Under Rigid Contacts and Other Unilateral Constraints
Saab, L., Ramos, O. E., Keith, F., Mansard, N., Soueres, P., & Fourquet, J.-Y. (2013) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2234351 · Cited by 226
RLOC: Terrain-Aware Legged Locomotion Using Reinforcement Learning and Optimal Control
Gangapurwala, S., Geisert, M., Orsolino, R., Fallon, M. F., & Havoutis, I. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3172469 · Cited by 208
Dynamic Locomotion Through Online Nonlinear Motion Optimization for Quadrupedal Robots
Bellicoso, C. D., Jenelten, F., Gehring, C., & Hutter, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2794620 · Cited by 206 · cited 2×
“The work of Bellicoso et al. [9] was extended by including a batch search for feasible footholds based on a given terrain map and foothold scoring [15].”
MethodSelf-citationRobust Rough-Terrain Locomotion with a Quadrupedal Robot
Fankhauser, P., Bjelonic, M., Dario Bellicoso, C., Miki, T., & Hutter, M. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460731 · Cited by 205
Self-citationTerrain mapping for a roving planetary explorer
Herbert, M., Caillas, C., Krotkov, E., Kweon, I. S., & Kanade, T. (2003) · Proceedings, 1989 International Conference on Robotics and Automation · doi:10.1109/robot.1989.100111 · Cited by 200
Contact Model Fusion for Event-Based Locomotion in Unstructured Terrains
Bledt, G., Wensing, P. M., Ingersoll, S., & Kim, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460904 · Cited by 197 · cited 1×
“Ageneralizedmomentumobserveris usedtoestimatethecontactstate[94].”
Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning
Siekmann, J., Green, K., Warila, J., Fern, A., & Hurst, J. (2021) · arXiv · doi:10.48550/arxiv.2105.08328 · Cited by 193
Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning
Siekmann, J., Green, K., Warila, J., Fern, A., & Hurst, J. (2021) · Robotics: Science and Systems XVII · doi:10.15607/rss.2021.xvii.061 · Cited by 193
An Efficient Acyclic Contact Planner for Multiped Robots
Tonneau, S., Prete, A. D., Pettré, J., Park, C., Manocha, D., & Mansard, N. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2819658 · Cited by 178
Feedback MPC for Torque-Controlled Legged Robots
Grandia, R., Farshidian, F., Ranftl, R., & Hutter, M. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968251 · Cited by 174
Self-citationFast, robust quadruped locomotion over challenging terrain
Kalakrishnan, M., Buchli, J., Pastor, P., Mistry, M., & Schaal, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509805 · Cited by 167
Perception-less terrain adaptation through whole body control and hierarchical optimization
Dario Bellicoso, C., Gehring, C., Hwangbo, J., Fankhauser, P., & Hutter, M. (2016) · 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2016.7803330 · Cited by 164
Self-citationMastalli, C., Havoutis, I., Focchi, M., Caldwell, D. G., & Semini, C. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3003464 · Cited by 153
Aceituno-Cabezas, B., Mastalli, C., Dai, H., Focchi, M., Radulescu, A., Caldwell, D. G., Cappelletto, J., Grieco, J. C., Fernández, G., & Semini, C. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2779821 · Cited by 152
Multi-Layered Safety for Legged Robots via Control Barrier Functions and Model Predictive Control
Grandia, R., Taylor, A. J., Ames, A. D., & Hutter, M. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561510 · Cited by 146
Self-citationAn efficient optimal planning and control framework for quadrupedal locomotion
Farshidian, F., Neunert, M., Winkler, A. W., Rey, G., & Buchli, J. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989016 · Cited by 134
Self-citationElevation Mapping for Locomotion and Navigation using GPU
Miki, T., Wellhausen, L., Grandia, R., Jenelten, F., Homberger, T., & Hutter, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981507 · Cited by 126
Self-citationPerceptive Locomotion in Rough Terrain – Online Foothold Optimization
Jenelten, F., Miki, T., Vijayan, A. E., Bjelonic, M., & Hutter, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3007427 · Cited by 122
Self-citationTAMOLS: Terrain-Aware Motion Optimization for Legged Systems
Jenelten, F., Grandia, R., Farshidian, F., & Hutter, M. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3186804 · Cited by 118
Self-citationAn Efficient Optimal Planning and Control Framework For Quadrupedal Locomotion
Farshidian, F., Neunert, M., Winkler, A., Rey, G., & Buchli, J. (2017) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 116
Self-citationBiConMP: A Nonlinear Model Predictive Control Framework for Whole Body Motion Planning
Meduri, A., Shah, P., Viereck, J., Khadiv, M., Havoutis, I., & Righetti, L. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3228390 · Cited by 116
Perceptive Model Predictive Control for Continuous Mobile Manipulation
Pankert, J., & Hutter, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3010721 · Cited by 115
Self-citationOffline motion libraries and online MPC for advanced mobility skills
Bjelonic, M., Grandia, R., Geilinger, M., Harley, O., Medeiros, V. S., Pajovic, V., Jelavić, E., Coros, S., & Hutter, M. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649221102473 · Cited by 103
Self-citationBledt, G., Wensing, P. M., & Kim, S. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206268 · Cited by 99
A Family of Iterative Gauss-Newton Shooting Methods for Nonlinear Optimal Control
Giftthaler, M., Neunert, M., Stäuble, M., Buchli, J., & Diehl, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593840 · Cited by 89
Fast and Continuous Foothold Adaptation for Dynamic Locomotion Through CNNs
Villarreal, O., Barasuol, V., Camurri, M., Franceschi, L., Focchi, M., Pontil, M., Caldwell, D. G., & Semini, C. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2899434 · Cited by 78
Trajectory Optimization With Implicit Hard Contacts
Carius, J., Ranftl, R., Koltun, V., & Hutter, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852785 · Cited by 76
Self-citationAdaptive Motion Planning for Autonomous Rough Terrain Traversal with a Walking Robot
Belter, D., Łabęcki, P., & Skrzypczyński, P. (2015) · Journal of Field Robotics · doi:10.1002/rob.21610 · Cited by 72
Agile Maneuvers in Legged Robots: a Predictive Control ApproachPreprint
Mastalli, C., Merkt, W., Xin, G., Shim, J., Mistry, M., Havoutis, I., & Vijayakumar, S. (2022) · Research Square · doi:10.21203/rs.3.rs-1870369/v1 · Cited by 62
Frequency-Aware Model Predictive Control
Grandia, R., Farshidian, F., Dosovitskiy, A., Ranftl, R., & Hutter, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2895882 · Cited by 57
Self-citationOn Time Optimization of Centroidal Momentum Dynamics
Pontón, B., Herzog, A., Prete, A. D., Schaal, S., & Righetti, L. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460537 · Cited by 57
Bajracharya, M., Ma, J., Malchano, M., Perkins, A., Rizzi, A. A., & Matthies, L. H. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696879 · Cited by 46
Quadruped robot trotting over irregular terrain assisted by stereo-vision
Bazeille, S., Barasuol, V., Focchi, M., Havoutis, I., Frigerio, M., Buchli, J., Caldwell, D. G., & Semini, C. (2014) · Intelligent Service Robotics · doi:10.1007/s11370-014-0147-9 · Cited by 45
Neural Scene Representation for Locomotion on Structured Terrain
Hoeller, D., Rudin, N., Choy, C., Anandkumar, A., & Hutter, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3184779 · Cited by 40
Self-citationOn-line and on-board planning and perception for quadrupedal locomotion
Mastalli, C., Havoutis, I., Winkler, A. W., Caldwell, D. G., & Semini, C. (2015) · IEEE International Conference on Technologies for Practical Robot Applications · doi:10.1109/tepra.2015.7219685 · Cited by 38
Frequency-Aware Model Predictive Control
Grandia, R., Farshidian, F., Dosovitskiy, A., Ranftl, R., & Hutter, M. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000323965 · Cited by 36
Self-citationMelon, O., Orsolino, R., Surovik, D. A., Geisert, M., Havoutis, I., & Fallon, M. F. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560794 · Cited by 36
Pardo, D., Neunert, M., Winkler, A., Grandia, R., & Buchli, J. (2017) · Robotics: Science and Systems · doi:10.15607/rss.2017.xiii.042 · Cited by 35
Self-citationSequential Linear Quadratic Optimal Control for Nonlinear Switched Systems
Farshidian, F., Kamgarpour, M., Pardo, D., & Buchli, J. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.291 · Cited by 30
Self-citationLocomotion Planning through a Hybrid Bayesian Trajectory Optimization
Seyde, T., Carius, J., Grandia, R., Farshidian, F., & Hutter, M. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794067 · Cited by 13
Self-citation
Cited by
ANYmal parkour: Learning agile navigation for quadrupedal robots
Hoeller, D., Rudin, N., Sako, D., & Hutter, M. (2024) · Science Robotics · doi:10.1126/scirobotics.adi7566 · Cited by 263
Self-citation
Metadata
- Authors
- Grandia, R., Jenelten, F., Yang, S., Farshidian, F., & Hutter, M.
- Venue
- IEEE Transactions on Robotics
- Published
- 2023-10
- Volume
- 39
- Issue
- 5
- Pages
- 3402-3421
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W4378696928
- Cited by
- 265
- References
- 76
- FWCI
- 19.15
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.