The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments
Open accessAbstract
Autonomous microhelicopters will soon play a major role in tasks like search and rescue, environment monitoring, security surveillance, and inspection. If they are further realized in small scale, they can also be used in narrow outdoor and indoor environments and represent only a limited risk for people. However, for such operations, navigating based only on global positioning system (GPS) information is not sufficient. Fully autonomous operation in cities or other dense environments requires microhelicopters to fly at low altitudes, where GPS signals are often shadowed, or indoors and to actively explore unknown environments while avoiding collisions and creating maps. This involves a number of challenges on all levels of helicopter design, perception, actuation, control, and navigation, which still have to be solved. The Swarm of Micro Flying Robots (SFLY) project was a European Union-funded project with the goal of creating a swarm of vision-controlled microaerial vehicles (MAVs) capable of autonomous navigation, three-dimensional (3-D) mapping, and optimal surveillance coverage in GPS-denied environments. The SFLY MAVs do not rely on remote control, radio beacons, or motion-capture systems but can fly all by themselves using only a single onboard camera and an inertial measurement unit (IMU). This article describes the technical challenges that have been faced and the results achieved from hardware design and embedded programming to vision-based navigation and mapping, with an overview of how all the modules work and how they have been integrated into the final system. Code, data sets, and videos are publicly available to the robotics community. Experimental results demonstrating three MAVs navigating autonomously in an unknown GPS-denied environment and performing 3-D mapping and optimal surveillance coverage are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Scalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
Coverage Control for Mobile Sensing Networks
Cortes, J., Martinez, S., Karatas, T., & Bullo, F. (2004) · IEEE Transactions on Robotics and Automation · doi:10.1109/tra.2004.824698 · Cited by 2,710
Minimum snap trajectory generation and control for quadrotors
Mellinger, D., & Kumar, V. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980409 · Cited by 2,367
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Self-citationG2o: A general framework for graph optimization
Kummerle, R., Grisetti, G., Strasdat, H., Konolige, K., & Burgard, W. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979949 · Cited by 1,982
Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control
Spall, J. C. (2003) · Wiley eBooks · doi:10.1002/0471722138 · Cited by 1,890
Scaramuzza, D., & Fraundorfer, F. (2011) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2011.943233 · Cited by 1,550
Self-citationHoward, A., Matarić, M. J., & Sukhatme, G. S. (2002) · Distributed Autonomous Robotic Systems 5 · doi:10.1007/978-4-431-65941-9_30 · Cited by 1,328
The GRASP Multiple Micro-UAV Testbed
Michael, N., Mellinger, D., Lindsey, Q., & Kumar, V. (2010) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.937855 · Cited by 768
Detailed Real-Time Urban 3D Reconstruction from Video
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.-J., Merrell, P., et al. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0086-4 · Cited by 717
Self-citationCooperative manipulation and transportation with aerial robots
Michael, N., Fink, J., & Kumar, V. (2011) · Autonomous Robots · doi:10.1007/s10514-010-9205-0 · Cited by 637
Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications
Fraundorfer, F., & Scaramuzza, D. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2182810 · Cited by 620
Self-citationKneip, L., Scaramuzza, D., & Siegwart, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995464 · Cited by 559
Self-citationVisual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J., & Sukhatme, G. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 536
Cooperative Manipulation and Transportation with Aerial Robots
Michael, N., Fink, J., & Kumar, V. (2010) · Robotics · doi:10.7551/mitpress/8727.003.0002 · Cited by 467
Vision based MAV navigation in unknown and unstructured environments
Blösch, M., Weiss, S., Scaramuzza, D., & Siegwart, R. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509920 · Cited by 428
Self-citationWeiss, S., Achtelik, M. W., Lynen, S., Chli, M., & Siegwart, R. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225147 · Cited by 417
Self-citationMonocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments
Weiss, S., Scaramuzza, D., & Siegwart, R. (2011) · Journal of Field Robotics · doi:10.1002/rob.20412 · Cited by 414 · cited 1×
“However, the first use of visual SLAM to enable autonomous basic maneuvers—such as take-off and landing, point-to-point navigation, and drift-free hovering on the spot—was done right within the framework of the SFLY project [13], [14].”
BackgroundSelf-citationA Fully Autonomous Indoor Quadrotor
Grzonka, S., Grisetti, G., & Burgard, W. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2162999 · Cited by 386
Autonomous multi-floor indoor navigation with a computationally constrained MAV
Shen, S., Michael, N., & Kumar, V. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980357 · Cited by 357
Martinelli, A. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2160468 · Cited by 279
Self-citationSensing and coverage for a network of heterogeneous robots
Pimenta, L. C. A., Kumar, V., Mesquita, R. C., & Pereira, G. A. S. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739194 · Cited by 279
A simple learning strategy for high-speed quadrocopter multi-flips
Lupashin, S., Schöllig, A., Sherback, M., & D'Andrea, R. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509452 · Cited by 278
Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments
Achtelik, M., Bachrach, A., He, R., Prentice, S., & Roy, N. (2009) · SPIE Proceedings · doi:10.1117/12.819082 · Cited by 266
Self-citationEfficient algorithms for geometric optimization
Agarwal, P. K., & Sharir, M. (1998) · ACM Computing Surveys · doi:10.1145/299917.299918 · Cited by 257
(2010) · Springer eBooks · doi:10.1007/978-3-540-89393-6 · Cited by 242
A simple learning strategy for high-speed quadrocopter multi-flips
Lupashin, S., Schoellig, A. P., Sherback, M., & D’Andrea, R. (2009) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.3929/ethz-a-005888743 · Cited by 242
Fly-inspired visual steering of an ultralight indoor aircraft
Zufferey, J.-C., & Floreano, D. (2006) · IEEE Transactions on Robotics · doi:10.1109/tro.2005.858857 · Cited by 233
Combined optic-flow and stereo-based navigation of urban canyons for a UAV
Hrabar, S., Sukhatme, G. S., Corke, P., Usher, K., & Roberts, J. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1544998 · Cited by 220
Real-time metric state estimation for modular vision-inertial systems
Weiss, S., & Siegwart, R. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979982 · Cited by 216
Self-citationVoronoi coverage of non-convex environments with a group of networked robots
Breitenmoser, A., Schwager, M., Metzger, J.-C., Siegwart, R., & Rus, D. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509696 · Cited by 215
Self-citationTopological mapping, localization and navigation using image collections
Fraundorfer, F., Engels, C., & Nister, D. (2007) · 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2007.4399123 · Cited by 202
Collaborative monocular SLAM with multiple Micro Aerial Vehicles
Forster, C., Lynen, S., Kneip, L., & Scaramuzza, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696923 · Cited by 201
Self-citationVision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments
Ahrens, S., Levine, D., Andrews, G., & How, J. P. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152680 · Cited by 176
Autonomous indoor 3D exploration with a micro-aerial vehicle
Shen, S., Michael, N., & Kumar, V. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225146 · Cited by 145
Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV
Weiß, S., Achtelik, M., Chli, M., & Siegwart, R. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225002 · Cited by 132
Self-citationVision Based Position Control for MAVs Using One Single Circular Landmark
Eberli, D., Scaramuzza, D., Weiß, S., & Siegwart, R. (2010) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-010-9494-8 · Cited by 112
Self-citationDoitsidis, L., Weiß, S., Renzaglia, A., Achtelik, M., Kosmatopoulos, E. B., Siegwart, R., & Scaramuzza, D. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9292-1 · Cited by 89
Self-citationAutonomous flight in unstructured and unknown indoor environments
Bachrach, A. (2009) · Cited by 87
Multi-robot three-dimensional coverage of unknown areas
Renzaglia, A., Doitsidis, L., Martinelli, A., & Kosmatopoulos, E. B. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912439332 · Cited by 78
Self-citationLarge Scale Nonlinear Control System Fine-Tuning Through Learning
Kosmatopoulos, E. B., & Kouvelas, A. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2014061 · Cited by 77
Self-citationVisibility-based multi-agent deployment in orthogonal environments
Ganguli, A., Cortés, J., & Bullo, F. (2007) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2007.4283034 · Cited by 50
Visual-inertial SLAM for a small helicopter in large outdoor environments
Achtelik, M., Lynen, S., Weiß, S., Kneip, L., Chli, M., & Siegwart, R. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386270 · Cited by 49
Self-citationPerception for a river mapping robot
Chambers, A., Achar, S., Nuske, S. T., Rehder, J., Kitt, B., Chamberlain, L., Haines, J., Scherer, S., & Singh, S. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6095040 · Cited by 36
Real-time photo-realistic 3D mapping for micro aerial vehicles
Heng, L., Lee, G. H., Fraundorfer, F., & Pollefeys, M. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6095058 · Cited by 28
Self-citationSensor-based robot deployment algorithms
Ny, J. L., & Pappas, G. J. (2010) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2010.5716979 · Cited by 18
Cited by
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Self-citationScience, technology and the future of small autonomous drones
Floreano, D., & Wood, R. J. (2015) · Nature · doi:10.1038/nature14542 · Cited by 1,476
Learning high-speed flight in the wild
Loquercio, A., Kaufmann, E., Ranftl, R., Müller, M., Koltun, V., & Scaramuzza, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abg5810 · Cited by 375
Self-citationThe current state and future outlook of rescue robotics
Delmerico, J., Mintchev, S., Giusti, A., Gromov, B., Melo, K., Horvat, T., Cadena, C., Hutter, M., Ijspeert, A., Floreano, D., et al. (2019) · Journal of Field Robotics · doi:10.1002/rob.21887 · Cited by 371
Self-citationUAV in the advent of the twenties: Where we stand and what is next
Nex, F., Armenakis, C., Cramer, M., Cucci, D. A., Gerke, M., Honkavaara, E., Kukko, A., Persello, C., & Skaloud, J. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.12.006 · Cited by 309
Metadata
- Authors
- Scaramuzza, D., Achtelik, M. C., Doitsidis, L., Friedrich, F., Kosmatopoulos, E., Martinelli, A., Achtelik, M. W., Chli, M., Chatzichristofis, S., Kneip, L., Gurdan, D., Heng, L., Lee, G. H., Lynen, S., Pollefeys, M., Renzaglia, A., Siegwart, R., Stumpf, J. C., Tanskanen, P., Troiani, C., Weiss, S., & Meier, L.
- Venue
- IEEE Robotics & Automation Magazine
- Published
- 2014-09
- Volume
- 21
- Issue
- 3
- Pages
- 26-40
- ISSN
- 1070-9932 (ISSN-L)
- 1558-223X
- OpenAlex
- W2000146415
- Cited by
- 299
- References
- 49
- FWCI
- 47.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.