The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Reinforcement Learning for UAV Attitude Control
Open accessAbstract
Autopilot systems are typically composed of an “inner loop” providing stability and control, whereas an “outer loop” is responsible for mission-level objectives, such as way-point navigation. Autopilot systems for unmanned aerial vehicles are predominately implemented using Proportional-Integral-Derivative (PID) control systems, which have demonstrated exceptional performance in stable environments. However, more sophisticated control is required to operate in unpredictable and harsh environments. Intelligent flight control systems is an active area of research addressing limitations of PID control most recently through the use of reinforcement learning (RL), which has had success in other applications, such as robotics. Yet previous work has focused primarily on using RL at the mission-level controller. In this work, we investigate the performance and accuracy of the inner control loop providing attitude control when using intelligent flight control systems trained with state-of-the-art RL algorithms—Deep Deterministic Policy Gradient, Trust Region Policy Optimization, and Proximal Policy Optimization. To investigate these unknowns, we first developed an open source high-fidelity simulation environment to train a flight controller attitude control of a quadrotor through RL. We then used our environment to compare their performance to that of a PID controller to identify if using RL is appropriate in high-precision, time-critical flight control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Optimum Settings for Automatic Controllers
Ziegler, J. G., & Nichols, N. B. (1942) · Journal of Fluids Engineering · doi:10.1115/1.4019264 · Cited by 5,212
Design and use paradigms for gazebo, an open-source multi-robot simulator
Koenig, N., & Howard, A. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389727 · Cited by 3,638
Optimum Settings for Automatic Controllers
Ziegler, J. G., & Nichols, N. B. (1993) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.2899060 · Cited by 2,460
Survey of gain-scheduling analysis and design
Leith, D. J., & Leithead, W. E. (2000) · International Journal of Control · doi:10.1080/002071700411304 · Cited by 939
Feedback linearization vs. adaptive sliding mode control for a quadrotor helicopter
Lee, D., Jin Kim, H., & Sastry, S. (2009) · International Journal of Control, Automation and Systems · doi:10.1007/s12555-009-0311-8 · Cited by 678
Noise and the reality gap: The use of simulation in evolutionary robotics
Jakobi, N., Husbands, P., & Harvey, I. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59496-5_337 · Cited by 631
Control of a Quadrotor With Reinforcement Learning
Hwangbo, J., Sa, I., Siegwart, R., & Hutter, M. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2720851 · Cited by 543
Evolving Mobile Robots in Simulated and Real Environments
Miglino, O., Lund, H. H., & Nolfi, S. (1995) · Artificial Life · doi:10.1162/artl.1995.2.4.417 · Cited by 358
A Simulation-Based Architecture for Smart Cyber-Physical Systems
Gabor, T., Belzner, L., Kiermeier, M., Beck, M. T., & Neitz, A. (2016) · 2016 IEEE International Conference on Autonomic Computing (ICAC) · doi:10.1109/icac.2016.29 · Cited by 298
Multi-agent quadrotor testbed control design: integral sliding mode vs. reinforcement learning
Waslander, S. L., Hoffmann, G. M., Jang, J. S., & Tomlin, C. J. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1545025 · Cited by 265
State-of-the-Art Intelligent Flight Control Systems in Unmanned Aerial Vehicles
Santoso, F., Garratt, M., & Anavatti, S. G. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2651109 · Cited by 146
Cited by
Drone Deep Reinforcement Learning: A Review
Azar, A. T., Koubaa, A., Ali Mohamed, N., Ibrahim, H. A., Ibrahim, Z. F., Kazim, M., Ammar, A., Benjdira, B., Khamis, A. M., Hameed, I. A., et al. (2021) · Electronics · doi:10.3390/electronics10090999 · Cited by 314
Dynamic and Multi-faceted Spatio-temporal Deep Learning for Traffic Speed Forecasting
Han, L., Du, B., Sun, L., Fu, Y., Lv, Y., & Xiong, H. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467275 · Cited by 281
Motion Planning for Mobile Robots—Focusing on Deep Reinforcement Learning: A Systematic Review
Sun, H., Zhang, W., Yu, R., & Zhang, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3076530 · Cited by 143
Nguyen, C. H., Shihua, J. M., & Liem, R. P. (2025) · Communications in Transportation Research · doi:10.1016/j.commtr.2025.100165 · Cited by 12
Employing Intelligent Aerial Data Aggregators for the Internet of Things: Challenges and Solutions
Li, K., Ni, W., Noor, A., & Guizani, M. (2022) · IEEE Internet of Things Magazine · doi:10.1109/iotm.001.2100161 · Cited by 11
Metadata
- Authors
- Koch, W., Mancuso, R., West, R., & Bestavros, A.
- Venue
- ACM Transactions on Cyber-Physical Systems
- Published
- 2019-02-13
- Volume
- 3
- Issue
- 2
- Pages
- 1-21
- ISSN
- 2378-962X (ISSN-L)
- 2378-9638
- OpenAlex
- W2797028887
- Cited by
- 499
- References
- 15
- FWCI
- 26.36
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.