The DOI matches its Crossref record.
PAMPC: Perception-Aware Model Predictive Control for Quadrotors
Open accessAbstract
We present the first perception-aware model predictive control framework for quadrotors that unifies control and planning with respect to action and perception objectives. Our framework leverages numerical optimization to compute trajectories that satisfy the system dynamics and require control inputs within the limits of the platform. Simultaneously, it optimizes perception objectives for robust and reliable sensing by maximizing the visibility of a point of interest and minimizing its velocity in the image plane. Considering both perception and action objectives for motion planning and control is challenging due to the possible conflicts arising from their respective requirements. For example, for a quadrotor to track a reference trajectory, it needs to rotate to align its thrust with the direction of the desired acceleration. However, the perception objective might require to minimize such rotation to maximize the visibility of a point of interest. A model-based optimization framework, able to consider both perception and action objectives and couple them through the system dynamics, is therefore necessary. Our perception-aware model predictive control framework works in a receding-horizon fashion by iteratively solving a non-linear optimization problem. It is capable of running in real-time, fully onboard our lightweight, small-scale quadrotor using a low-power ARM computer, together with a visual-inertial odometry pipeline. We validate our approach in experiments demonstrating (I) the conflict between perception and action objectives, and (II) improved behavior in extremely challenging lighting conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 21
- bangura, 2014, Real-time model predictive control for quadrotors, IFAC World Congress
- 10.1109/IROS.2017.8206522 · doi:10.1109/iros.2017.8206522
- 10.1177/0278364917728327 · doi:10.1177/0278364917728327
- costante, 2018, Exploiting photometric information for planning under uncertainty, Robotics Research, 1, 107, 10.1007/978-3-319-51532-8_7 · DOI
- 10.15607/RSS.2014.X.029 · DOI
- 10.1109/IROS.2016.7759815 · DOI
- 10.1109/LRA.2017.2665693 · DOI · Paper page
- nageli, 2017, Real-time planning for automated multi-view drone cinematography, SIG GRA PH
- potena, 2017, Effective target aware visual navigation for uavs, Proc Eur Conf Mobile Robots
- szeliski, 2010, Computer Vision Algorithms and Applications
- 10.1109/IROS.2013.6696851 · DOI
- mueller, 2015, A computationally efficient motion primitive for quadrocopter trajectory generation, IEEE Trans Robot, 31, 10.1109/TRO.2015.2479878 · DOI · Paper page
- 10.1109/LRA.2016.2633290 · DOI · Paper page
- falanga, 2017, Aggres-sive quadrotor flight through narrow gaps with onboard sensing and computing, IEEE Int Conf Robot Autom
- kamel, 2016, Linear vs nonlinear mpc for trajectory tracking applied to rotary wing micro aerial vehicles
- su, 2016, Catching a flying ball with a vision-based quadrotor, Int Symp Experimental Robotics
- 10.1109/ICRA.2011.5980409 · DOI · Paper page
- mellinger, 2010, Trajectory generation and control for precise aggressive maneuvers with quadrotors, Int Symp Experimental Robotics
- 10.1109/ICRA.2016.7487274 · DOI · Paper page
- 10.1016/j.automatica.2011.08.020 · DOI · Paper page
- 10.1002/oca.939 · DOI · Paper page
Cited by
Learning high-speed flight in the wild
Loquercio, A., Kaufmann, E., Ranftl, R., Müller, M., Koltun, V., & Scaramuzza, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abg5810 · Cited by 375
Self-citationRAPTOR: Robust and Perception-Aware Trajectory Replanning for Quadrotor Fast Flight
Zhou, B., Pan, J., Gao, F., & Shen, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3071527 · Cited by 308
Advances in intelligent and autonomous navigation systems for small UAS
Bijjahalli, S., Sabatini, R., & Gardi, A. (2020) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2020.100617 · Cited by 123
Perception-Aware Perching on Powerlines With Multirotors
Paneque, J. L., Dios, J. R. M.-D., Ollero, A., Hanover, D., Sun, S., Romero, A., & Scaramuzza, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3145514 · Cited by 36
Self-citationDmytruk, A., Silano, G., Bicego, D., Licea, D. B., & Saska, M. (2022) · 2022 International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas54217.2022.9836071 · Cited by 8
“Among these, the Model Predictive Control (MPC) scheme has been proven to be a promising solution to control the UAV motion while complying with its dynamics and multiple heterogeneous constraints, such as those coming from the visual part [5]–[7].”
BackgroundMethodInfluential
Metadata
- Authors
- Falanga, D., Foehn, P., Lu, P., & Scaramuzza, D.
- Venue
- 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 1-8
- OpenAlex
- W2963689432
- Cited by
- 244
- References
- 0
- FWCI
- 30.68
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: PAMPC: Perception-Aware Model Predictive Control for Quadrotors. https://app.cochat.ai/papers/10.1109/iros.2018.8593739
- The paper
- Falanga, D., Foehn, P., Lu, P., & Scaramuzza, D. (2018). PAMPC: Perception-Aware Model Predictive Control for Quadrotors. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://doi.org/10.1109/iros.2018.8593739
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.