The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Safe controller optimization for quadrotors with Gaussian processes
Open accessAbstract
One of the most fundamental problems when designing controllers for dynamic systems is the tuning of the controller parameters. Typically, a model of the system is used to obtain an initial controller, but ultimately the controller parameters must be tuned manually on the real system to achieve the best performance. To avoid this manual tuning step, methods from machine learning, such as Bayesian optimization, have been used. However, as these methods evaluate different controller parameters on the real system, safety-critical system failures may happen. In this paper, we overcome this problem by applying, for the first time, a recently developed safe optimization algorithm, SafeOpt, to the problem of automatic controller parameter tuning. Given an initial, low-performance controller, SafeOpt automatically optimizes the parameters of a control law while guaranteeing safety. It models the underlying performance measure as a Gaussian process and only explores new controller parameters whose performance lies above a safe performance threshold with high probability. Experimental results on a quadrotor vehicle indicate that the proposed method enables fast, automatic, and safe optimization of controller parameters without human intervention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,159
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
Self-citationAutomatic tuning and adaptation for PID controllers - a survey
Åström, K. J., Hägglund, T. J., Hang, C. C., & Ho, W. K. (1993) · Control Engineering Practice · doi:10.1016/0967-0661(93)91394-c · Cited by 686
Provably safe and robust learning-based model predictive control
Aswani, A., Gonzalez, H., Sastry, S. S., & Tomlin, C. (2013) · Automatica · doi:10.1016/j.automatica.2013.02.003 · Cited by 539
Convergence rates of efficient global optimization algorithms
Bull, A. D. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1101.3501 · Cited by 446
Bayesian Approach to Global Optimization--Theory and Applications.
Boender, C. G. E., & Mockus, J. (1991) · Mathematics of Computation · doi:10.2307/2008419 · Cited by 409
PID tuning using extremum seeking: online, model-free performance optimization
Killingsworth, N., & Krstić, M. (2006) · IEEE Control Systems · doi:10.1109/mcs.2006.1580155 · Cited by 396
Safe Exploration for Optimization with Gaussian Processes
Sui, Y., Gotovos, A., Burdick, J. W., & Krause, A. (2015) · CaltechAUTHORS (California Institute of Technology) · Cited by 302
Self-citationBayesian Optimization with Unknown Constraints
Gelbart, M. A., Snoek, J., & Adams, R. P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.5607 · Cited by 299
Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics
Berkenkamp, F., Krause, A., & Schoellig, A. P. (2023) · Machine Learning · doi:10.1007/s10994-021-06019-1 · Cited by 286
Self-citationReachability-based safe learning with Gaussian processes
Akametalu, A. K., Fisac, J. F., Gillula, J. H., Kaynama, S., Zeilinger, M. N., & Tomlin, C. J. (2014) · 53rd IEEE Conference on Decision and Control · doi:10.1109/cdc.2014.7039601 · Cited by 249
Automatic gait optimization with Gaussian process regression
Lizotte, D. J., Wang, T., Bowling, M., & Schuurmans, D. (2007) · Cited by 237
Safe and robust learning control with Gaussian processes
Berkenkamp, F., & Schoellig, A. P. (2015) · 2015 European Control Conference (ECC) · doi:10.1109/ecc.2015.7330913 · Cited by 169
Self-citationGenetic Algorithms and Robotics
Davidor, Y. (1991) · World Scientific series in robotics and intelligent systems · doi:10.1142/1111 · Cited by 168
Safe Exploration in Markov Decision Processes
Moldovan, T. M., & Abbeel, P. (2012) · arXiv · doi:10.48550/arxiv.1205.4810 · Cited by 152
Automatic LQR tuning based on Gaussian process global optimization
Marco, A., Hennig, P., Bohg, J., Schaal, S., & Trimpe, S. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487144 · Cited by 149
Safe Exploration for Active Learning with Gaussian Processes
Schreiter, J., Nguyen-Tuong, D., Eberts, M., Bischoff, B., Markert, H., & Toussaint, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23461-8_9 · Cited by 89
Using response surfaces and expected improvement to optimize snake robot gait parameters
Tesch, M., Schneider, J., & Choset, H. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6095076 · Cited by 86
An experimental comparison of Bayesian optimization for bipedal locomotion
Calandra, R., Andre Seyfarth, A., Peters, J., & Deisenroth, M. P. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907117 · Cited by 78
Cited by
A survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,406
Learning-Based Model Predictive Control: Toward Safe Learning in Control
Hewing, L., Wabersich, K. P., Menner, M., & Zeilinger, M. N. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-090419-075625 · Cited by 835
Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics
Berkenkamp, F., Krause, A., & Schoellig, A. P. (2023) · Machine Learning · doi:10.1007/s10994-021-06019-1 · Cited by 286
Self-citationNeural Lander: Stable Drone Landing Control Using Learned Dynamics
Shi, G., Shi, X., O'Connell, M., Yu, R., Azizzadenesheli, K., Anandkumar, A., Yue, Y., & Chung, S.-J. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794351 · Cited by 281
A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials
Chatzilygeroudis, K., Vassiliades, V., Stulp, F., Calinon, S., & Mouret, J.-B. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2958211 · Cited by 160
Metadata
- Authors
- Berkenkamp, F., Schoellig, A. P., & Krause, A.
- Venue
- 2016 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2016-05
- Pages
- 491-496
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2143277772
- Cited by
- 264
- References
- 20
- FWCI
- 39.67
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.