The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Learning-Based Model Predictive Control for Safe Exploration
Abstract
Learning-based methods have been successful in solving complex control tasks without significant prior knowledge about the system. However, these methods typically do not provide any safety guarantees, which prevents their use in safety-critical, real-world applications. In this paper, we present a learning-based model predictive control scheme that can provide provable high-probability safety guarantees. To this end, we exploit regularity assumptions on the dynamics in terms of a Gaussian process prior to construct provably accurate confidence intervals on predicted trajectories. Unlike previous approaches, we do not assume that model uncertainties are independent. Based on these predictions, we guarantee that trajectories satisfy safety constraints. Moreover, we use a terminal set constraint to recursively guarantee the existence of safe control actions at every iteration. In our experiments, we show that the resulting algorithm can be used to safely and efficiently explore and learn about dynamic systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483
Linear Optimal Control Systems
Kwakernaak, H., Sivan, R., & Tyreus, B. N. D. (1974) · Journal of Dynamic Systems, Measurement, and Control · doi:10.1115/1.3426828 · Cited by 4,976
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
Self-citationPILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,136
Provably safe and robust learning-based model predictive control
Aswani, A., Gonzalez, H., Sastry, S. S., & Tomlin, C. (2013) · Automatica · doi:10.1016/j.automatica.2013.02.003 · Cited by 539
A General-Purpose Software Framework for Dynamic Optimization
Andersson, J. (2013) · Lirias · Cited by 405
Safe Model-based Reinforcement Learning with Stability Guarantees
Berkenkamp, F., Turchetta, M., Schoellig, A. P., & Krause, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08551 · Cited by 299
Self-citationBayesian optimization with safety constraints: safe and automatic parameter tuning in robotics
Berkenkamp, F., Krause, A., & Schoellig, A. P. (2023) · Machine Learning · doi:10.1007/s10994-021-06019-1 · Cited by 286
Self-citationGaussian process model based predictive control
Kocijan, J., Murray-Smith, R., Rasmussen, C. E., & Girard, A. (2004) · Proceedings of the 2004 American Control Conference · doi:10.23919/acc.2004.1383790 · Cited by 267
Reachability-based safe learning with Gaussian processes
Akametalu, A. K., Fisac, J. F., Gillula, J. H., Kaynama, S., Zeilinger, M. N., & Tomlin, C. J. (2014) · 53rd IEEE Conference on Decision and Control · doi:10.1109/cdc.2014.7039601 · Cited by 249
Robust Constrained Learning-based NMPC enabling reliable mobile robot path tracking
Ostafew, C. J., Schoellig, A. P., & Barfoot, T. D. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364916645661 · Cited by 232
Reinforcement Learning Versus Model Predictive Control: A Comparison on a Power System Problem
Ernst, D., Glavic, M., Capitanescu, F., & Wehenkel, L. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007630 · Cited by 214
Safe learning of regions of attraction for uncertain, nonlinear systems with Gaussian processes
Berkenkamp, F., Moriconi, R., Schoellig, A. P., & Krause, A. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798979 · Cited by 189
Self-citationLinear Model Predictive Safety Certification for Learning-Based Control
Wabersich, K. P., & Zeilinger, M. N. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619829 · Cited by 167
Robust variable horizon model predictive control for vehicle maneuvering
Richards, A. G., & How, J. P. (2006) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.1059 · Cited by 148
Cautious NMPC with Gaussian Process Dynamics for Autonomous Miniature Race Cars
Hewing, L., Liniger, A., & Zeilinger, M. N. (2018) · European Control Conference (ECC) · doi:10.23919/ecc.2018.8550162 · Cited by 139
A deterministic algorithm for global optimization
Breiman, L., & Cutler, A. (1993) · Mathematical Programming · doi:10.1007/bf01581266 · Cited by 137
Gaussian Process Model Predictive Control of an Unmanned Quadrotor
Cao, G., Lai, E. M.-K., & Alam, F. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0549-y · Cited by 122
Learning and Control Using Gaussian Processes
Jain, A., Nghiem, T. X., Morari, M., & Mangharam, R. (2018) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps.2018.00022 · Cited by 94
Model-based reinforcement learning with parametrized physical models and optimism-driven exploration
Xie, C., Patil, S., Moldovan, T. M., Levine, S., & Abbeel, P. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487172 · Cited by 45
A provably correct MPC approach to safety control of urban traffic networks
Sadraddini, S., & Belta, C. A. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7525158 · Cited by 15
Cited by
Review on model predictive control: an engineering perspective
Schwenzer, M., Ay, M., Bergs, T., & Abel, D. (2021) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-021-07682-3 · Cited by 1,132
All you need to know about model predictive control for buildings
Drgoňa, J., Arroyo, J., Cupeiro Figueroa, I., Blum, D., Arendt, K., Kim, D., Ollé, E. P., Oravec, J., Wetter, M., Vrabie, D. L., et al. (2020) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2020.09.001 · Cited by 1,020
Learning-Based Model Predictive Control: Toward Safe Learning in Control
Hewing, L., Wabersich, K. P., Menner, M., & Zeilinger, M. N. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-090419-075625 · Cited by 835
Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning
Brunke, L., Greeff, M., Hall, A. W., Yuan, Z., Zhou, S., Panerati, J., & Schoellig, A. P. (2022) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-042920-020211 · Cited by 769
Cautious Model Predictive Control Using Gaussian Process Regression
Hewing, L., Kabzan, J., & Zeilinger, M. N. (2020) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2019.2949757 · Cited by 577
Metadata
- Authors
- Koller, T., Berkenkamp, F., Turchetta, M., & Krause, A.
- Venue
- 2018 IEEE Conference on Decision and Control (CDC)
- Publisher
- IEEE
- Published
- 2018-12
- Pages
- 6059-6066
- ISSN
- 0191-2216 (ISSN-L)
- OpenAlex
- W2892521964
- Cited by
- 318
- References
- 26
- FWCI
- 54.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.