Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback
Open accessAbstract
This paper presents a visual-inertial odometry framework that tightly fuses inertial measurements with visual data from one or more cameras, by means of an iterated extended Kalman filter. By employing image patches as landmark descriptors, a photometric error is derived, which is directly integrated as an innovation term in the filter update step. Consequently, the data association is an inherent part of the estimation process and no additional feature extraction or matching processes are required. Furthermore, it enables the tracking of noncorner-shaped features, such as lines, and thereby increases the set of possible landmarks. The filter state is formulated in a fully robocentric fashion, which reduces errors related to nonlinearities. This also includes partitioning of a landmark’s location estimate into a bearing vector and distance and thereby allows an undelayed initialization of landmarks. Overall, this results in a compact approach, which exhibits a high level of robustness with respect to low scene texture and motion blur. Furthermore, there is no time-consuming initialization procedure and pose estimates are available starting at the second image frame. We test the filter on different real datasets and compare it with other state-of-the-art visual-inertial frameworks. Experimental results show that robust localization with high accuracy can be achieved with this filter-based framework.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Few heterogeneous datasets of sizes suitable for deep learning on RGB-D data are available.
“While numerous datasets aimed at vision-aided odometry exist [39], [40], [41], [42], [43], [44], few heterogeneous datasets of sizes suitable for deep learning applications on RGB-D data are available.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [40]
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · see citing works
(1981) · Cited by 11,963 · see citing works
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 4× · see citing works
“If we minimize the squared error terms for a multilevel patch, we obtain a patch alignment algorithm which is very similar to the well-known Kanade-Lucas-Tomasi (KLT) feature tracker (Lucas and Kanade (1981); Shi and Tomasi (1994)).”
MethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771 · see citing works
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555 · see citing works
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · see citing works
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205 · see citing works
The EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,086 · see citing works
Self-citationA Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951 · see citing works
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990916 · Cited by 1,884 · see citing works
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238654 · Cited by 1,749 · see citing works
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M. C., Siegwart, R., & Furgale, P. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,718 · see citing works
Self-citationOn-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502 · see citing works
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 934 · see citing works
Self-citationHigh-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813 · see citing works
Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J. W., & Sukhatme, G. S. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 537 · see citing works
The iterated Kalman filter update as a Gauss-Newton method
Bell, B. M., & Cathey, F. W. (1993) · IEEE Transactions on Automatic Control · doi:10.1109/9.250476 · Cited by 510 · see citing works
Real-time monocular SLAM: Why filter?
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509636 · Cited by 485 · see citing works
Visual-inertial navigation, mapping and localization: A scalable real-time causal approach
Jones, E., & Soatto, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910388963 · Cited by 431 · see citing works
Unified Inverse Depth Parametrization for Monocular SLAM
Montiel, J., Civera, J., & Davison, A. (2006) · Robotics: Science and Systems II · doi:10.15607/rss.2006.ii.011 · Cited by 377 · see citing works
A counter example to the theory of simultaneous localization and map building
Julier, S. J., & Uhlmann, J. K. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2001.933280 · Cited by 321 · see citing works
Hertzberg, C., Wagner, R., Frese, U., & Schröder, L. (2011) · Information Fusion · doi:10.1016/j.inffus.2011.08.003 · Cited by 290 · see citing works
Get Out of My Lab: Large-scale, Real-Time Visual-Inertial Localization
Lynen, S., Sattler, T., Bosse, M., Hesch, J., Pollefeys, M., & Siegwart, R. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.037 · Cited by 243 · cited 1× · see citing works
“However, all odometry frameworks inherently suffer from drift and, if the primary goal is localization accuracy, a back-end framework doing global mapping, re-localization and loop closure will be indispensable (e.g. Lynen et al. (2015)).”
BackgroundSelf-citationLimits to the consistency of EKF-based SLAM
Castellanos, J. A., Neira, J., & Tardós, J. D. (2004) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)32063-3 · Cited by 243 · see citing works
Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium
Weiß, S., Achtelik, M., Lynen, S., Achtelik, M. C., Kneip, L., Chli, M., & Siegwart, R. (2013) · Journal of Field Robotics · doi:10.1002/rob.21466 · Cited by 235 · see citing works
Self-citationDirect visual-inertial odometry with stereo cameras
Usenko, V., Engel, J. J., Stückler, J., & Cremers, D. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487335 · Cited by 225 · see citing works
Analysis and improvement of the consistency of extended Kalman filter based SLAM
Huang, G. P., Mourikis, A. I., & Roumeliotis, S. I. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543252 · Cited by 222 · see citing works
Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines
Solà, J., Vidal‐Calleja, T., Civera, J., & Montiel, J. M. M. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0492-5 · Cited by 149 · see citing works
An Efficient Direct Approach to Visual SLAM
Silveira, G., Malis, E., & Rives, P. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004829 · Cited by 143 · see citing works
State estimation for legged robots on unstable and slippery terrain
Bloesch, M., Gehring, C., Fankhauser, P., Hutter, M., Hoepflinger, M. A., & Siegwart, R. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6697236 · Cited by 136 · see citing works
Self-citationStereo-vision-based navigation of a six-legged walking robot in unknown rough terrain
Stelzer, A., Hirschmüller, H., & Görner, M. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911435161 · Cited by 121 · see citing works
Locally Planar Patch Features for Real-Time Structure from Motion
Molton, N., Davison, A. J., & Reid, I. D. (2004) · British Machine Vision Conference (BMVC) · doi:10.5244/c.18.90 · Cited by 119 · see citing works
1-point RANSAC for EKF-based Structure from Motion
Civera, J., Grasa, Ó. G., Davison, A. J., & Montiel, J. M. M. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354410 · Cited by 119 · see citing works
A semi-direct approach to structure from motion
Jin, H., Favaro, P., & Soatto, S. (2003) · The Visual Computer · doi:10.1007/s00371-003-0202-6 · Cited by 96 · see citing works
Semi-direct EKF-based monocular visual-inertial odometry
Tanskanen, P., Nägeli, T., Pollefeys, M., & Hilliges, O. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354242 · Cited by 51 · see citing works
Real-time pose estimation of a dynamic quadruped in GPS-denied environments for 24-hour operation
Ma, J., Bajracharya, M., Susca, S., Matthies, L. H., & Malchano, M. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915587333 · Cited by 45 · see citing works
Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs
Shen, S., Mulgaonkar, Y., Michael, N., & Kumar, V. R. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_15 · Cited by 40 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodríguez, J. J. G., Montiel, J. M. M., & Tardos, J. D. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,676 · see citing works
FAST-LIO: A Fast, Robust LiDAR-Inertial Odometry Package by Tightly-Coupled Iterated Kalman Filter
Xu, W. D., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3064227 · Cited by 1,159 · see citing works
2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Joshi, B., Rahman, S., Kalaitzakis, M., Cain, B., Johnson, J. V., Xanthidis, M., Karapetyan, N., Hernandez, A., Li, A. Q., Vitzilaios, N. I., et al. (2019) · doi:10.1109/iros40897.2019 · Cited by 1,091 · see citing works
OpenVINS: A Research Platform for Visual-Inertial Estimation
Geneva, P., Eckenhoff, K., Lee, W., Yang, Y., & Huang, G. P. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196524 · Cited by 711 · see citing works
The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stückler, J., & Cremers, D. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 497 · see citing works
LINS: A Lidar-Inertial State Estimator for Robust and Efficient Navigation
Qin, C., Ye, H., Pranata, C. E., Han, J., Zhang, S., & Liu, M. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197567 · Cited by 406 · see citing works
Visual-Inertial Navigation: A Concise Review
Huang, G. P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793604 · Cited by 401 · see citing works
PL-VIO: Tightly-Coupled Monocular Visual–Inertial Odometry Using Point and Line Features
He, Y., Zhao, J. Y., Guo, Y., He, W., & Yuan, K. (2018) · Sensors · doi:10.3390/s18041159 · Cited by 331 · see citing works
An Efficient Sampling-Based Method for Online Informative Path Planning in Unknown Environments
Schmid, L., Pantic, M., Khanna, R., Ott, L., Siegwart, R., & Nieto, J. I. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969191 · Cited by 311 · see citing works
Self-citationVisual-Inertial Mapping With Non-Linear Factor Recovery
Usenko, V., Demmel, N., Schubert, D., Stuckler, J., & Cremers, D. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2961227 · Cited by 250 · see citing works
A Survey on Odometry for Autonomous Navigation Systems
Mohamed, S., Haghbayan, M., Westerlund, T., Heikkonen, J., Tenhunen, H., & Plosila, J. (2019) · IEEE Access · doi:10.1109/access.2019.2929133 · Cited by 213 · see citing works
VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots
Wisth, D., Camurri, M., & Fallon, M. F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3193788 · Cited by 183 · see citing works
Selective Sensor Fusion for Neural Visual-Inertial Odometry
Chen, C., Rosa, S., Miao, Y., Lu, C. X., Wu, W., Markham, A., & Trigoni, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01079 · Cited by 178 · see citing works
Khattak, S., Nguyen, H., Mascarich, F., Dang, T., & Alexis, K. (2020) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas48674.2020.9213865 · Cited by 152 · see citing works
Guerra, W., Tal, E. A., Murali, V., Ryou, G., & Karaman, S. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968116 · Cited by 139 · see citing works
Camera, LiDAR, and IMU Based Multi-Sensor Fusion SLAM: A Survey
Zhu, J., Li, H., & Zhang, T. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2023.9010010 · Cited by 132 · see citing works
Chen, C., Zhu, H. J., Li, M., & You, S. (2018) · Robotics · doi:10.3390/robotics7030045 · Cited by 131 · see citing works
SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensor
Rahman, S., Li, A. Q., & Rekleitis, I. M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967703 · Cited by 131 · see citing works
A review of monocular visual odometry
He, M., Zhu, C., Huang, Q., Ren, B., & Liu, J. (2019) · The Visual Computer · doi:10.1007/s00371-019-01714-6 · Cited by 127 · see citing works
IC-GVINS: A Robust, Real-Time, INS-Centric GNSS-Visual-Inertial Navigation System
Niu, X., Tang, H., Zhang, T., Fan, J. F., & Liu, J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3224367 · Cited by 124 · see citing works
SelfVIO: Self-supervised deep monocular Visual–Inertial Odometry and depth estimation
Almalıoğlu, Y., Turan, M., Saputra, M. R. U., de Gusmão, P. P. B., Markham, A., & Trigoni, N. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.005 · Cited by 121 · see citing works
Tranzatto, M., Mascarich, F., Bernreiter, L., Godinho, C., Camurri, M., Khattak, S., Dang, T., Reijgwart, V., Loeje, J., Wisth, D., et al. (2022) · Field Robotics · doi:10.55417/fr.2022011 · Cited by 118 · see citing works
Self-citationJoshi, B., Rahman, S., Kalaitzakis, M., Cain, B., Johnson, J. V., Xanthidis, M., Karapetyan, N., Hernandez, A., Li, A. Q., Vitzilaios, N. I., et al. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968049 · Cited by 113 · see citing works
SVIn2: A multi-sensor fusion-based underwater SLAM system
Rahman, S., Li, A. Q., & Rekleitis, I. M. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649221110259 · Cited by 112 · see citing works
State of the Art in Vision-Based Localization Techniques for Autonomous Navigation Systems
Alkendi, Y., Seneviratne, L. D., & Zweiri, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3082778 · Cited by 107 · see citing works
History-Aware Autonomous Exploration in Confined Environments Using MAVs
Witting, C., Fehr, M., Behnemann, R., Oleynikova, H., & Siegwart, R. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594502 · Cited by 106 · see citing works
Self-citationClosed-form preintegration methods for graph-based visual–inertial navigation
Eckenhoff, K., Geneva, P., & Huang, G. P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919835021 · Cited by 101 · see citing works
Voxgraph: Globally Consistent, Volumetric Mapping Using Signed Distance Function Submaps
Reijgwart, V., Millane, A., Oleynikova, H., Siegwart, R., Cadena, C., & Nieto, J. I. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2953859 · Cited by 99 · see citing works
Self-citationRobust Real-time LiDAR-inertial Initialization
Zhu, F., Ren, Y., & Zhang, F. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982225 · Cited by 99 · see citing works
Autonomous aerial robotics for package delivery: A technical review
Saunders, J., Sajad Saeedi, G., & Li, W. (2023) · Journal of Field Robotics · doi:10.1002/rob.22231 · Cited by 99 · see citing works
ADVIO: An Authentic Dataset for Visual-Inertial Odometry
Cortés, S., Solin, A., Rahtu, E., & Kannala, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_26 · Cited by 98 · see citing works
Robocentric Visual-Inertial Odometry
Huai, Z., & Huang, G. P. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593643 · Cited by 97 · see citing works
DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusion
Düzçeker, A., Galliani, S., Vogel, C., Speciale, P., Dusmanu, M., & Pollefeys, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01507 · Cited by 96 · see citing works
Run Your Visual-Inertial Odometry on NVIDIA Jetson: Benchmark Tests on a Micro Aerial Vehicle
Jeon, J., Jung, S., Lee, E. M., Choi, D., & Myung, H. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3075141 · Cited by 96 · see citing works
The Urban Last Mile Problem: Autonomous Drone Delivery to Your Balcony
Brunner, G., Szebedy, B., Tanner, S., & Wattenhofer, R. P. (2019) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2019.8798337 · Cited by 95 · see citing works
VPS-SLAM: Visual Planar Semantic SLAM for Aerial Robotic Systems
Bavle, H., de la Puente, P., How, J., & Campoy, P. (2020) · IEEE Access · doi:10.1109/access.2020.2983121 · Cited by 81 · see citing works
PLF-VINS: Real-Time Monocular Visual-Inertial SLAM With Point-Line Fusion and Parallel-Line Fusion
Lee, J., & Park, S.-Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3095518 · Cited by 85 · see citing works
Robocentric visual–inertial odometry
Huai, Z., & Huang, G. (2018) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.1177/0278364919853361 · Cited by 185 · see citing works
GapFlyt: Active Vision Based Minimalist Structure-Less Gap Detection For Quadrotor Flight
Sanket, N. J., Singh, C. D., Ganguly, K., Fermuller, C. M., & Aloimonos, Y. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2843445 · Cited by 91 · see citing works
Survey on Localization Systems and Algorithms for Unmanned Systems
Yuan, S., Wang, H., & Xie, L. (2020) · Unmanned Systems · doi:10.1142/s230138502150014x · Cited by 91 · see citing works
GNSS-denied UAV indoor navigation with UWB incorporated visual inertial odometry
Lin, H., & Zhan, J.-R. (2022) · Measurement · doi:10.1016/j.measurement.2022.112256 · Cited by 89 · see citing works
Robust Legged Robot State Estimation Using Factor Graph Optimization
Wisth, D., Camurri, M., & Fallon, M. F. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2933768 · Cited by 87 · see citing works
Keyframe‐based thermal–inertial odometry
Khattak, S., Papachristos, C., & Alexis, K. (2019) · Journal of Field Robotics · doi:10.1002/rob.21932 · Cited by 87 · see citing works
Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery
Shamwell, E. J., Lindgren, K., Leung, S., & Nothwang, W. D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2909895 · Cited by 86 · see citing works
Keyframe-based Direct Thermal–Inertial Odometry
Khattak, S., Papachristos, C., & Alexis, K. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793927 · Cited by 81 · see citing works
Tran, N. X. B., Rosser, K., & Chahl, J. (2021) · Journal of Imaging · doi:10.3390/jimaging7100217 · Cited by 82 · see citing works
Oleynikova, H., Lanegger, C., Taylor, Z., Pantic, M., Millane, A., Siegwart, R., & Nieto, J. I. (2020) · Journal of Field Robotics · doi:10.1002/rob.21950 · Cited by 77 · see citing works
Self-citationSchmid, L., Delmerico, J., Schönberger, J. L., Nieto, J. I., Pollefeys, M., Siegwart, R., & Cadena, C. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811877 · Cited by 73 · see citing works
Self-citationAvoiding Dynamic Small Obstacles With Onboard Sensing and Computation on Aerial Robots
Kong, F., Xu, W. D., Cai, Y., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3101877 · Cited by 72 · see citing works
maplab 2.0 – A Modular and Multi-Modal Mapping Framework
Cramariuc, A., Bernreiter, L., Tschopp, F., Fehr, M., Reijgwart, V., Nieto, J. I., Siegwart, R., & Cadena, C. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3227865 · Cited by 71 · see citing works
Self-citationExploiting Symmetries to Design EKFs With Consistency Properties for Navigation and SLAM
Brossard, M., Barrau, A., & Bonnabel, S. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2882714 · Cited by 69 · see citing works
Wang, S., & Ahmad, N. S. (2024) · IEEE Access · doi:10.1109/access.2024.3519874 · Cited by 68 · see citing works
Trifo-VIO: Robust and Efficient Stereo Visual Inertial Odometry Using Points and Lines
Zheng, F., Tsai, G., Zhang, Z., Liu, S., Chu, C.-C., & Hu, H. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594354 · Cited by 68 · see citing works
UAV/UGV Autonomous Cooperation: UAV assists UGV to climb a cliff by attaching a tether
Miki, T., Khrapchenkov, P., & Hori, K. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794265 · Cited by 67 · see citing works
A Survey on Visual Navigation and Positioning for Autonomous UUVs
Qin, J., Li, M., Li, D., Zhong, J., & Yang, K. (2022) · Remote Sensing · doi:10.3390/rs14153794 · Cited by 65 · see citing works
A Framework for UAV Navigation and Exploration in GPS-Denied Environments
Vanegas, F., Gaston, K. J., Roberts, J. M., & Gonzalez, F. (2019) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2019.8741612 · Cited by 65 · see citing works
Edge-Assisted Multi-Robot Visual-Inertial SLAM With Efficient Communication
Liu, X., Wen, S., Zhao, J., Qiu, T. Z., & Zhang, H. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3376427 · Cited by 64 · see citing works
RD-VIO: Robust visual-inertial odometry for mobile augmented reality in dynamic environments
Li, J., Pan, X., Huang, G., Zhang, Z., Wang, N., Bao, H., & Zhang, G. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3353263 · Cited by 62 · see citing works
“ROVIO [4] is another filtering-based system that used photometric errors for visual observation.”
MethodTeng, S., Mueller, M. W., & Sreenath, K. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561313 · Cited by 60 · see citing works
On-Manifold Model Predictive Control for Trajectory Tracking on Robotic Systems
Lu, G., Xu, W. D., & Zhang, F. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3212397 · Cited by 57 · see citing works
ORB-TEDM: An RGB-D SLAM Approach Fusing ORB Triangulation Estimates and Depth Measurements
Yuan, J., Zhu, S., Tang, K., & Sun, Q. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3154800 · Cited by 56 · see citing works
A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
Huang, B., Zhao, J., Luo, S., & Liu, J. (2021) · Journal of Global Positioning Systems · doi:10.5081/jgps.17.1.94 · Cited by 54 · see citing works
EqVIO: An Equivariant Filter for Visual-Inertial Odometry
van Goor, P., & Mahony, R. (2022) · IEEE Transactions on robotics · doi:10.1109/tro.2023.3289587 · Cited by 56 · see citing works
Visual-Thermal Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments
Khattak, S., Papachristos, C., & Alexis, K. (2019) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2019.8741787 · Cited by 52 · see citing works
Online multi-sensor calibration based on moving object tracking
Peršić, J., Petrović, L., Marković, I., & Petrovic, I. K. (2020) · Advanced Robotics · doi:10.1080/01691864.2020.1819874 · Cited by 51 · see citing works
Sensors and Sensor Fusion Methodologies for Indoor Odometry: A Review
Yang, M., Sun, X. S., Jia, F., Rushworth, A. G. A., Dong, X., Zhang, S., Fang, Z., Yang, G., & Liu, B. (2022) · Polymers · doi:10.3390/polym14102019 · Cited by 49 · see citing works
Overview of Multi-Robot Collaborative SLAM from the Perspective of Data Fusion
Chen, W.-F., Wang, X., Gao, S.-P., Shang, G., Zhou, C., Li, Z., Xu, C., & Hu, K. (2023) · Machines · doi:10.3390/machines11060653 · Cited by 49 · see citing works
Huai, J., Lin, Y., Zhuang, Y., Toth, C. K., & Chen, D. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3172474 · Cited by 48 · see citing works
Visual Localization by Learning Objects-Of-Interest Dense Match Regression
Weinzaepfel, P., Csurka, G., Cabon, Y., & Humenberger, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00578 · Cited by 48 · see citing works
An Efficient Schmidt-EKF for 3D Visual-Inertial SLAM
Geneva, P., Maley, J., & Huang, G. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01238 · Cited by 47 · see citing works
Decoupled Right Invariant Error States for Consistent Visual-Inertial Navigation
Yang, Y., Chen, C., Lee, W., & Huang, G. P. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3140054 · Cited by 46 · see citing works
Thermal-Inertial Localization for Autonomous Navigation of Aerial Robots through Obscurants
Papachristos, C., Mascarich, F., & Alexis, K. (2018) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2018.8453447 · Cited by 46 · see citing works
InGVIO: A Consistent Invariant Filter for Fast and High-Accuracy GNSS-Visual-Inertial Odometry
Liu, C., Jiang, C., & Wang, H. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3243520 · Cited by 45 · see citing works
LIRO: Tightly Coupled Lidar-Inertia-Ranging Odometry
Nguyen, T., Cao, M., Yuan, S., Lyu, Y., Nguyen, T. H., & Xie, L. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560954 · Cited by 45 · see citing works
Continuous-Time Fixed-Lag Smoothing for LiDAR-Inertial-Camera SLAM
Lv, J.-J., Lang, X.-L., Xu, J., Wang, M.-M., Liu, Y., & Zuo, X. (2023) · IEEE/ASME transactions on mechatronics · doi:10.1109/tmech.2023.3241398 · Cited by 59 · see citing works
Xue, C., Huang, Y., Zhao, C. B., Li, X., Mihaylova, L. S., Li, Y., & Chambers, J. A. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3213787 · Cited by 44 · see citing works
Robust Thermal-Inertial Localization for Aerial Robots: A Case for Direct Methods
Khattak, S., Mascarich, F., Dang, T., Papachristos, C., & Alexis, K. (2019) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2019.8798279 · Cited by 43 · see citing works
Preintegrated Velocity Bias Estimation to Overcome Contact Nonlinearities in Legged Robot Odometry
Wisth, D., Camurri, M., & Fallon, M. F. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197214 · Cited by 42 · see citing works
DVIO: An Optimization-Based Tightly Coupled Direct Visual-Inertial Odometry
Jiang, J.-Q., Yuan, J., Zhang, X.-T., & Zhang, X.-B. (2021) · IEEE transactions on industrial electronics (1982. Print) · doi:10.1109/tie.2020.3036243 · Cited by 37 · see citing works
Kalman Filters on Differentiable ManifoldsPreprint
He, D., Xu, W. D., & Zhang, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03804 · Cited by 42 · see citing works
Shamwell, E. J., Leung, S., & Nothwang, W. D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593573 · Cited by 41 · see citing works
Wang, F., Zou, Y., Zhang, C., Buzzatto, J., Liarokapis, M., Castillo, E. D. R., & Lim, J. B. P. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105139 · Cited by 37 · see citing works
Chen, H., Quan, F., Fang, L., & Zhang, S. (2019) · Sensors · doi:10.3390/s19194253 · Cited by 41 · see citing works
Doer, C., & Trommer, G. F. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636799 · Cited by 41 · see citing works
Stereo Visual SLAM Based on Unscented Dual Quaternion Filtering
Bultmann, S., Li, K., & Hanebeck, U. (2019) · Fusion · doi:10.23919/fusion43075.2019.9011391 · Cited by 51 · see citing works
Rolling-Shutter Modelling for Direct Visual-Inertial Odometry
Schubert, D., Demmel, N., von Stumberg, L., Usenko, V., & Cremers, D. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968539 · Cited by 39 · see citing works
A Survey of Simultaneous Localization and Mapping.
Huang, B., Zhao, J., & Liu, J. (2019) · Cited by 38 · see citing works
Edge-Based Monocular Thermal-Inertial Odometry in Visually Degraded Environments
Wang, Y., Chen, H., Liu, Y., & Zhang, S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3246381 · Cited by 37 · see citing works
An End-to-End UAV Simulation Platform for Visual SLAM and Navigation
Chen, S., Zhou, W., Yang, A., Chen, H., Li, B., & Wen, C. (2022) · Aerospace · doi:10.3390/aerospace9020048 · Cited by 37 · see citing works
The GRIFFIN Perception Dataset: Bridging the Gap Between Flapping-Wing Flight and Robotic Perception
Gómez, J. P. R., Tapia, R., Paneque, J. L., Grau, P., Eguíluz, A. G., Dios, J. R. M., & Ollero, A. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3056348 · Cited by 36 · see citing works
Schmid, L., Reijgwart, V., Ott, L., Nieto, J. I., Siegwart, R., & Cadena, C. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068954 · Cited by 35 · see citing works
Self-citationA survey: which features are required for dynamic visual simultaneous localization and mapping?
Xu, Z., Rong, Z., & Wu, Y. (2021) · Visual Computing for Industry, Biomedicine, and Art · doi:10.1186/s42492-021-00086-w · Cited by 33 · see citing works
PLJ-SLAM: Monocular Visual SLAM With Points, Lines, and Junctions of Coplanar Lines
Ren, G., Cao, Z., Liu, X., Tan, M. H., & Yu, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3185122 · Cited by 34 · see citing works
RP-VIO: Robust Plane-based Visual-Inertial Odometry for Dynamic Environments
Ram, K., Kharyal, C., Harithas, S. S., & Krishna, K. M. (2021) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.1109/iros51168.2021.9636522 · Cited by 33 · see citing works
Continuous-Time State Estimation Methods in Robotics: A Survey
Talbot, W., Nubert, J., Tuna, T., Cadena, C., Dümbgen, F., Tordesillas, J., Barfoot, T. D., & Hutter, M. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3593079 · Cited by 32 · see citing works
Self-citationHe, D., Xu, W. D., & Zhang, F. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3237872 · Cited by 32 · see citing works
Accurate Monocular Visual-Inertial SLAM Using a Map-Assisted EKF Approach
Quan, M.-X., Piao, S.-H., Tan, M., & Huang, S.-S. (2017) · IEEE Access · doi:10.1109/access.2019.2904512 · Cited by 28 · see citing works
Design and Autonomous Stabilization of a Ballistically-Launched Multirotor
Bouman, A., Nadan, P. M., Anderson, M., Pastor, D., Izraelevitz, J., Burdick, J. W., & Kennedy, B. A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197542 · Cited by 31 · see citing works
Tightly-Coupled Fusion of VINS and Motion Constraint for Autonomous Vehicle
Yu, Z., Zhu, L., & Lu, G. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3162155 · Cited by 31 · see citing works
A real time LiDAR-Visual-Inertial object level semantic SLAM for forest environments
Liu, H., Xu, G., Liu, B., Li, Y., Yang, S., Tang, J., Pan, K., & Xing, Y. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.11.013 · Cited by 30 · see citing works
- Authors
- Bloesch, M., Burri, M., Omari, S., Hutter, M., & Siegwart, R.
- Affiliations
- ETH Zurich (CH)
- Corresponding author
- Bloesch, Michael
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2017-09
- Volume
- 36
- Issue
- 10
- Pages
- 1053-1072
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2754177129
- Cited by
- 485
- References
- 37
- Citations by year
- 2026: 30 · 2025: 53 · 2024: 53 · 2023: 64 · 2022: 69 · 2021: 68 · 2020: 51 · 2019: 68 · 2018: 29
- FWCI
- 37.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- The International Journal of Robotics Research (publishedVersion)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
- ETH Zürich Research Collection
- The International Journal of Robotics Research
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (149427, 200021)
- National Centre of Competence in Research Robotics
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual-inertial odometry, iterated extended Kalman filter, photometric errors, data association, landmark initialization, motion blur robustness, pose estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
