DeepVIO: Self-supervised Deep Learning of Monocular Visual Inertial Odometry using 3D Geometric Constraints
Open accessAbstract
This paper presents an self-supervised deep learning network for monocular visual inertial odometry (named DeepVIO). DeepVIO provides absolute trajectory estimation by directly merging 2D optical flow feature (OFF) and Inertial Measurement Unit (IMU) data. Specifically, it firstly estimates the depth and dense 3D point cloud of each scene by using stereo sequences, and then obtains 3D geometric constraints including 3D optical flow and 6-DoF pose as supervisory signals. Note that such 3D optical flow shows robustness and accuracy to dynamic objects and textureless environments. In DeepVIO training, 2D optical flow network is constrained by the projection of its corresponding 3D optical flow, and LSTM-style IMU preintegration network and the fusion network are learned by minimizing the loss functions from ego-motion constraints. Furthermore, we employ an IMU status update scheme to improve IMU pose estimation through updating the additional gyroscope and accelerometer bias. The experimental results on KITTI and EuRoC datasets show that DeepVIO outperforms state-of-the-art learning based methods in terms of accuracy and data adaptability. Compared to the traditional methods, DeepVIO reduces the impacts of inaccurate Camera-IMU calibrations, unsynchronized and missing data.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898 · see citing works
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · see citing works
VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
Qin, T., Li, P., & Shen, S. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2853729 · Cited by 4,669 · see citing works
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313 · see citing works
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596 · see citing works
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270 · see citing works
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.179 · Cited by 3,177 · see citing works
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,094 · see citing works
Engel, J. J., Koltun, V., & Cremers, D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,995 · see citing works
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910 · see citing works
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951 · see citing works
Pyramid Stereo Matching Network
Chang, J.-R., & Chen, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00567 · Cited by 1,882 · see citing works
Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
Garg, R., B.G., V. K., Carneiro, G., & Reid, I. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_45 · Cited by 1,632 · see citing works
On-Manifold Preintegration for Real-Time Visual--Inertial Odometry
Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2597321 · Cited by 1,502 · see citing works
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose
Yin, Z., & Shi, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00212 · Cited by 1,280 · see citing works
Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration
Yang, J., Li, H., Campbell, D., & Jia, Y. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2513405 · Cited by 1,177 · see citing works
Deepvo: towards end-to-end visual odometry with deep recurrent convolutional neural networks
Wang, S., Clark, R., Wen, H., & Trigoni, N. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989236 · Cited by 970 · see citing works
Robust visual inertial odometry using a direct EKF-based approach
Bloesch, M., Omari, S., Hutter, M., & Siegwart, R. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353389 · Cited by 934 · see citing works
Visual-Inertial Monocular SLAM With Map Reuse
Mur-Artal, R., & Tardós, J. D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2653359 · Cited by 790 · see citing works
Zhan, H., Garg, R., Weerasekera, C. S., Li, K., Agarwal, H., & Reid, I. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00043 · Cited by 705 · see citing works
Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications
Fraundorfer, F., & Scaramuzza, D. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2182810 · Cited by 620 · see citing works
UnDeepVO: Monocular Visual Odometry Through Unsupervised Deep Learning
Li, R., Wang, S., Long, Z., & Gu, D. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461251 · Cited by 596 · see citing works
Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Sun, K., Mohta, K., Pfrommer, B., Watterson, M., Liu, S., Mulgaonkar, Y., Taylor, C. J., & Kumar, V. R. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793349 · Cited by 542 · see citing works
DF-Net: Unsupervised Joint Learning of Depth and Flow Using Cross-Task Consistency
Zou, Y., Luo, Z., & Huang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_3 · Cited by 484 · see citing works
Keyframe-Based Visual-Inertial SLAM using Nonlinear Optimization
Leutenegger, S., Furgale, P., Rabaud, V., Chli, M., Konolige, K., & Siegwart, R. (2013) · Robotics: Science and Systems · doi:10.15607/rss.2013.ix.037 · Cited by 480 · see citing works
Casser, V., Pirk, S., Mahjourian, R., & Angelova, A. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v33i01.33018001 · Cited by 473 · see citing works
Robust Visual Inertial Odometry Using a Direct EKF-Based Approach
Bloesch, M., Omari, S., Hutter, M., et al. (2015) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010566547 · Cited by 424 · see citing works
VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem
Clark, R., Wang, S., Wen, H., Markham, A., & Trigoni, N. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11215 · Cited by 346 · see citing works
End-to-end, sequence-to-sequence probabilistic visual odometry through deep neural networks
Wang, S., Clark, R., Wen, H.-K., & Trigoni, N. (2018) · Int. J. Robotics Res. · doi:10.1177/0278364917734298 · Cited by 224 · see citing works
Efficient Dense Scene Flow from Sparse or Dense Stereo Data
Wedel, A., Rabe, C., Vaudrey, T., Brox, T., Franke, U., & Cremers, D. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88682-2_56 · Cited by 176 · see citing works
Keyframe-based Visual-Inertial SLAM using Nonlinear Optimization
Leutenegger, S., Furgale, P., Rabaud, V., Chli, M., Konolige, K., & Siegwart, R. (2013) · doi:10.3929/ethz-b-000236658 · Cited by 169 · see citing works
VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem
Clark, R., Wang, S., Wen, H., Markham, A., & Trigoni, N. (2017) · Warwick Research Archive Portal (University of Warwick) · doi:10.5555/3298023.3298149 · Cited by 102 · see citing works
Ongoing Evolution of Visual SLAM from Geometry to Deep Learning: Challenges and Opportunities
Li, R., Wang, S., & Gu, D. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9591-8 · Cited by 76 · see citing works
Learning to Fuse: A Deep Learning Approach to Visual-Inertial Camera Pose Estimation
Rambach, J. R., Tewari, A., Pagani, A., & Stricker, D. (2016) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2016.19 · Cited by 53 · see citing works
Learning Monocular Visual Odometry with Dense 3D Mapping from Dense 3D Flow
Zhao, C., Sun, L., Purkait, P., Duckett, T., & Stolkin, R. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594151 · Cited by 50 · see citing works
Shamwell, E. J., Leung, S., & Nothwang, W. D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593573 · Cited by 41 · see citing works
Learning monocular visual odometry with dense 3D mapping from dense 3D flowPreprint
Zhao, C., Sun, L., Purkait, P., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02286 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774 · see citing works
A survey of state-of-the-art on visual SLAM
Kazerouni, I. A., Fitzgerald, L., Dooly, G., & Toal, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117734 · Cited by 396 · see citing works
An Overview on Visual SLAM: From Tradition to Semantic
Chen, W.-F., Shang, G., Ji, A.-H., Zhou, C., Wang, X., Xu, C., Li, Z., & Hu, K. (2022) · Remote Sensing · doi:10.3390/rs14133010 · Cited by 217 · see citing works
Critical Design and Control Issues of Indoor Autonomous Mobile Robots: A Review
Niloy, M. A., Shama, A., Chakrabortty, R. K., Ryan, M. J., Badal, F. R., Tasneem, Z., Ahamed, M. H., Moyeen, S. I., Das, S. K., Ali, M. F., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3062557 · Cited by 162 · see citing works
Deep Learning for Inertial Positioning: A Survey
Chen, C., & Pan, X. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3381161 · Cited by 145 · see citing works
Simultaneous Localization and Mapping (SLAM) for Autonomous Driving: Concept and Analysis
Zheng, S., Jinling Wang, A., Rizos, C., Ding, W., & El‐Mowafy, A. (2023) · Remote Sensing · doi:10.3390/rs15041156 · Cited by 129 · see citing works
Wang, K., Ma, S., Chen, J., Ren, F., & Lu, J. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3038898 · Cited by 114 · see citing works
Chen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12567 · Cited by 130 · see citing works
Deep Learning for Visual Localization and Mapping: A Survey
Chen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3309809 · Cited by 97 · see citing works
Deep Learning Based Wearable Assistive System for Visually Impaired People
Lin, Y., Wang, K., Yi, W., & Lian, S. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00312 · Cited by 88 · see citing works
Self-citationAn Overview of Key SLAM Technologies for Underwater Scenes
Wang, X., Fan, X., Shi, P., Ni, J., & Zhou, Z. (2023) · Remote Sensing · doi:10.3390/rs15102496 · Cited by 70 · see citing works
A Survey on Visual Navigation and Positioning for Autonomous UUVs
Qin, J., Li, M., Li, D., Zhong, J., & Yang, K. (2022) · Remote Sensing · doi:10.3390/rs14153794 · Cited by 65 · see citing works
LiDAR, IMU, and camera fusion for simultaneous localization and mapping: a systematic review
Fan, Z., Zhang, L.-L., Wang, X.-Y., Shen, Y., & Deng, F. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11187-w · Cited by 80 · see citing works
Wang, S., & Ahmad, N. S. (2024) · IEEE Access · doi:10.1109/access.2024.3519874 · Cited by 68 · see citing works
OdoNet: Untethered Speed Aiding for Vehicle Navigation Without Hardware Wheeled Odometer
Tang, H., Niu, X., Zhang, T., Li, Y., & Liu, J. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3169549 · Cited by 55 · see citing works
Efficient Deep Visual and Inertial Odometry with Adaptive Visual Modality Selection
Yang, M., Chen, Y., & Kim, H.-S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19839-7_14 · Cited by 51 · see citing works
Sensors and Sensor Fusion Methodologies for Indoor Odometry: A Review
Yang, M., Sun, X. S., Jia, F., Rushworth, A. G. A., Dong, X., Zhang, S., Fang, Z., Yang, G., & Liu, B. (2022) · Polymers · doi:10.3390/polym14102019 · Cited by 49 · see citing works
An Outline of Multi-Sensor Fusion Methods for Mobile Agents Indoor Navigation
Qu, Y., Yang, M., Zhang, J., Xie, W., Qiang, B., & Chen, J. (2021) · Sensors · doi:10.3390/s21051605 · Cited by 48 · see citing works
SkyEye: Self-Supervised Bird's-Eye-View Semantic Mapping Using Monocular Frontal View Images
Gosala, N., Petek, K., Drews, P., Burgard, W., & Valada, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01431 · Cited by 41 · see citing works
Learning Selective Sensor Fusion for State Estimation
Chen, C., Rosa, S., Lu, C. X., Wang, B., Trigoni, N., & Markham, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3176677 · Cited by 46 · see citing works
Zhang, S., Zhang, J., & Tao, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19839-7_9 · Cited by 42 · see citing works
Aslan, M. F., Durdu, A., & Sabancı, K. (2022) · Measurement · doi:10.1016/j.measurement.2022.111030 · Cited by 35 · see citing works
VIUNet: Deep Visual–Inertial–UWB Fusion for Indoor UAV Localization
Kao, P.-Y., Chang, H.-J., Tseng, K.-W., Chen, T., Luo, H.-L., & Hung, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3279292 · Cited by 35 · see citing works
An Improved UKF for IMU State Estimation Based on Modulation LSTM Neural Network
Luo, J., Wu, K., Wang, Y., Wang, T., Zhang, G., & Liu, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3368040 · Cited by 35 · see citing works
Deep Learning for Underwater Visual Odometry Estimation
Teixeira, B., Silva, H., Matos, A., & Silva, E. (2020) · IEEE Access · doi:10.1109/access.2020.2978406 · Cited by 31 · see citing works
Unsupervised Monocular Visual-inertial Odometry Network
Peng, W., Hua, G., Huang, W., Meng, F., & Liu, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/325 · Cited by 35 · see citing works
LSTM and Filter Based Comparison Analysis for Indoor Global Localization in UAVs
Yusefi, A., Durdu, A., Aslan, M. F., & Sungur, C. (2021) · IEEE Access · doi:10.1109/access.2021.3049896 · Cited by 36 · see citing works
ATVIO: Attention Guided Visual-Inertial Odometry
Liu, L., Li, G., & Li, T. H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413912 · Cited by 35 · see citing works
Nam, D. V., & Kim, G.-W. (2020) · Sensors · doi:10.3390/s20102922 · Cited by 35 · see citing works
Adaptive VIO: Deep Visual-Inertial Odometry with Online Continual Learning
Pan, Y., Zhou, W., Cao, Y., & Zha, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01706 · Cited by 34 · see citing works
Fu, T., Su, S., Lu, Y., & Wang, C. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3382533 · Cited by 30 · see citing works
DVI-SLAM: A Dual Visual Inertial SLAM Network
Peng, X., Liu, Z., Li, W., Tan, P., Cho, S. Y., & Wang, Q. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610042 · Cited by 28 · see citing works
New Artificial Intelligence Approach to Inclination Measurement Based on MEMS Accelerometer
Hoang, M. L., & Pietrosanto, A. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3105494 · Cited by 28 · see citing works
RobustStateNet: Robust ego vehicle state estimation for Autonomous Driving
Dahal, P., Mentasti, S., Paparusso, L., Arrigoni, S., & Braghin, F. (2023) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2023.104585 · Cited by 27 · see citing works
SuperVINS: A Real-Time Visual-Inertial SLAM Framework for Challenging Imaging Conditions
Luo, H., Liu, Y., Guo, C., Li, Z., & Song, W. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3556257 · Cited by 32 · see citing works
Golroudbari, A. A., & Sabour, M. H. (2023) · doi:10.22541/au.168664884.43899660/v1 · Cited by 22 · see citing works
Irfan, M., Dalai, S., Trslić, P., Riordan, J. F., & Dooly, G. (2025) · Machines · doi:10.3390/machines13020130 · Cited by 20 · see citing works
The YTU dataset and recurrent neural network based visual-inertial odometry
Gürtürk, M., Yusefi, A., Aslan, M. F., Soycan, M., Durdu, A., & Masiero, A. (2021) · Measurement · doi:10.1016/j.measurement.2021.109878 · Cited by 19 · see citing works
HyperPCM: Robust Task-Conditioned Modeling of Drug–Target Interactions
Svensson, E., Hoedt, P.-J., Hochreiter, S., & Klambauer, G. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01417 · Cited by 20 · see citing works
Irfan, M., Dalai, S., Trslić, P., dos Santos, M. C., Riordan, J. F., & Dooly, G. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3469551 · Cited by 18 · see citing works
Self-Supervised Ego-Motion Estimation Based on Multi-Layer Fusion of RGB and Inferred Depth
Jiang, Z., Taira, H., Miyashita, N., & Okutomi, M. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811842 · Cited by 17 · see citing works
Multi-Modal Neural Feature Fusion for Automatic Driving Through Perception-Aware Path Planning
Li, Z., Zhou, A., Pu, J., & Yu, J. (2021) · IEEE Access · doi:10.1109/access.2021.3120720 · Cited by 19 · see citing works
Camera, LiDAR, and IMU Spatiotemporal Calibration: Methodological Review and Research Perspectives
Lyu, X., Liu, S., Qiao, R., Jiang, S., & Wang, Y. (2025) · Sensors · doi:10.3390/s25175409 · Cited by 15 · see citing works
Learned Monocular Depth Priors in Visual-Inertial Initialization
Zhou, Y., Kar, A., Turner, E., Kowdle, A., Guo, C. X., DuToit, R. C., & Tsotsos, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20047-2_32 · Cited by 15 · see citing works
Imperative learning: A self-supervised neuro-symbolic learning framework for robot autonomy
Wang, C., Ji, K., Geng, J., Ren, Z., Fu, T., Yang, F., Guo, Y., He, H., Chen, X., Zhan, Z., et al. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649251353181 · Cited by 17 · see citing works
Learning to Compensate for the Drift and Error of Gyroscope in Vehicle Localization
Zhao, X., Deng, C., Kong, X., Xu, J., & Liu, Y. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304715 · Cited by 13 · see citing works
Vision-state Fusion: Improving Deep Neural Networks for Autonomous Robotics
Cereda, E., Bonato, S., Nava, M., Giusti, A., & Palossi, D. (2024) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-024-02091-6 · Cited by 12 · see citing works
Pajula, I., Joswig, N., Morrison, A. J., Sokolova, N., & Ruotsalainen, L. (2023) · IEEE Journal of Indoor and Seamless Positioning and Navigation · doi:10.1109/jispin.2023.3344077 · Cited by 11 · see citing works
CMIF-VIO: A Novel Cross Modal Interaction Framework for Visual Inertial Odometry
Wang, Z., Zhang, Y., Xu, X., Xiong, M., Su, X., & Meng, F. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511374 · Cited by 10 · see citing works
Scale-Aware Visual-Inertial Depth Estimation and Odometry Using Monocular Self-Supervised Learning
Lee, C., Kim, C., Kim, P., Lee, H., & Kim, H. J. (2023) · IEEE Access · doi:10.1109/access.2023.3252884 · Cited by 10 · see citing works
Ott, F., Heublein, L., Rügamer, D., Bischl, B., & Mutschler, C. (2024) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2024.104256 · Cited by 11 · see citing works
A Novel Feedback Mechanism-Based Stereo Visual-Inertial SLAM
Bai, J., Gao, J., Lin, Y., Liu, Z., Lian, S., & Liu, D. (2019) · IEEE Access · doi:10.1109/access.2019.2946352 · Cited by 9 · see citing works
Self-citationEnd-to-End Deep Learning Framework for Real-Time Inertial Attitude Estimation using 6DoF IMUPreprint
Golroudbari, A. A., & Sabour, M. H. (2023) · doi:10.22541/au.167628608.89589390/v1 · Cited by 9 · see citing works
Mamba model guided deep visual-inertial odometry
Liu, J., Zheng, Q., Ma, W., Zhu, P., & Zong, Y. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111326 · Cited by 8 · see citing works
Li, J., Leng, Q., Liu, J., Xu, X., Jin, T., Cao, M., Nguyen, T.-M., Yuan, S., Cao, K., & Xie, L. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128564 · Cited by 8 · see citing works
DOES: A Deep Learning-Based Approach to Estimate Roll and Pitch at Sea
Ciaccio, F. D., Russo, P., & Troisi, S. (2022) · IEEE Access · doi:10.1109/access.2022.3158971 · Cited by 8 · see citing works
Learning‐based monocular visual‐inertial odometry with SE2(3) $S{E}_{2}(3)$‐EKF
Guo, C., Hu, J., & Luo, Y. (2024) · Journal of Field Robotics · doi:10.1002/rob.22349 · Cited by 8 · see citing works
Search for Efficient Deep Visual-Inertial Odometry Through Neural Architecture Search
Chen, Y., Yang, M., & Kim, H.-S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095166 · Cited by 8 · see citing works
Golroudbari, A. A., & Sabour, M. H. (2023) · doi:10.22541/au.168664884.43899660/v2 · Cited by 8 · see citing works
SelectFusion: A Generic Framework to Selectively Learn Multisensory Fusion.Preprint
Chen, C., Rosa, S., Lu, C. X., Trigoni, N., & Markham, A. (2019) · arXiv (Cornell University) · Cited by 7 · see citing works
Wei, J., Song, M. H., & Yuan, Y. (2025) · Remote Sensing · doi:10.3390/rs17071136 · Cited by 6 · see citing works
A Comparative Analysis of Hybrid Sensor Fusion Schemes for Visual-Inertial Navigation
Tabassum, T. E., Petrunin, I. V., & Rana, Z. A. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3555758 · Cited by 7 · see citing works
Wang, J., Wu, X., Tian, J., Liu, E., Wu, Y., Lai, R., & Tian, Y. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3568978 · Cited by 6 · see citing works
SPVIO: Pose-Only Visual Inertial Odometry With State Transformation and Visual-Deprived Correction
Du, X., Zhang, L., Ji, C., Luo, X., Wang, M., Wu, W., & Mao, J. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3603436 · Cited by 6 · see citing works
Ho, H.-Y., Ng, H., Leung, Y.-T., Wen, W., Hsu, L., & Luo, Y. (2023) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-w1-2023-175-2023 · Cited by 6 · see citing works
Scale-Aware Monocular Visual Odometry and Extrinsic Calibration Using Vehicle Kinematics
Kim, C., Jang, Y., Kim, J., Kim, P., & Kim, H. J. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3309833 · Cited by 6 · see citing works
Rapid SLAM Method for Star Surface Rover in Unstructured Space Environments
Zhang, Z., Cheng, Y., Bu, L., & Ye, J. (2024) · Aerospace · doi:10.3390/aerospace11090768 · Cited by 6 · see citing works
Learning Multiplicative Interactions with Bayesian Neural Networks for Visual-Inertial OdometryPreprint
Shinde, K., Lee, J., Humt, M., Sezgin, A., & Triebel, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07630 · Cited by 9 · see citing works
TTCDist: Fast Distance Estimation From an Active Monocular Camera Using Time-to-Contact
Burner, L., Sanket, N. J., Fermuller, C. M., & Aloimonos, Y. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160683 · Cited by 5 · see citing works
StereoVO: Learning Stereo Visual Odometry Approach Based on Optical Flow and Depth Information
Duan, C., Junginger, S., Thurow, K., & Liu, H. (2023) · Applied Sciences · doi:10.3390/app13105842 · Cited by 5 · see citing works
Low-Cost MEMS IMU Calibration Using Deep Learning and Visual-Inertial Odometry
Hosseini, H., & Atashgah, M. A. A. (2023) · RSI International Conference on Robotics and Mechatronics (ICRoM) · doi:10.1109/icrom60803.2023.10412527 · Cited by 5 · see citing works
Monocular visual odometry for underground railway scenarios
Etxeberria-Garcia, M., Labayen, M., Eizaguirre, F., Zamalloa, M., & Arana-Arexolaleiba, N. (2021) · International Conference on Quality Control by Artificial Vision (QCAV) · doi:10.1117/12.2586310 · Cited by 5 · see citing works
RWKV-VIO: An Efficient and Low-Drift Visual–Inertial Odometry Using an End-to-End Deep Network
Yang, J., Xu, X., Xu, Z., Wu, Z., & Chu, W. (2025) · Sensors · doi:10.3390/s25185737 · Cited by 4 · see citing works
Zhang, X., He, Z., Ma, Z., Jun, P., & Yang, K. (2021) · Sensors · doi:10.3390/s21186302 · Cited by 4 · see citing works
Wang, Y., Yang, H., Cai, J., Wang, G., Wang, J., & Huang, Y. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160277 · Cited by 4 · see citing works
Self-supervised Scale Recovery for Decoupled Visual-inertial Odometry
Zhang, T., Zhu, D., Shi, W., Liu, Y., Zhang, G., Zhang, X., & Li, J. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3338047 · Cited by 4 · see citing works
Multi-Sensor Fusion Self-Supervised Deep Odometry and Depth Estimation
Wan, Y., Zhao, Q., Guo, C., Xu, C., & Fang, L. (2022) · Remote Sensing · doi:10.3390/rs14051228 · Cited by 5 · see citing works
A PSO–ML-LSTM-based IMU state estimation approach for manipulator teleoperation
Zhou, R., Li, Y., Zhang, A., Zhang, T., Guan, Y., Zhao, Z., & Chen, S. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1638853 · Cited by 3 · see citing works
Pereira, T., Viegas, C. X. P., Soares, S., & Ferreira, N. (2026) · Robotics · doi:10.3390/robotics15020035 · Cited by 6 · see citing works
Huang, F., Wen, W., Zhang, G., Su, D., & Hsu, L. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422216 · Cited by 4 · see citing works
Edwards, S., Mihaylova, L. S., Aitken, J. M., & Anderson, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89177-0_19 · Cited by 3 · see citing works
Multisensor fusion for marine infrastructures’ inspection and safety
Sudevan, V., Mankovskii, N., Javed, S., Karki, H., Masi, G., & Dias, J. M. M. (2022) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans47191.2022.9977154 · Cited by 3 · see citing works
CertainOdom: Uncertainty Weighted Multi-task Learning Model for LiDAR Odometry Estimation
Sun, L., Ding, G., Yoshiyasu, Y., & Kanehiro, F. (2022) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio55434.2022.10011808 · Cited by 3 · see citing works
Sudevan, V., Zayer, F., Javed, S., Karki, H., Masi, G., & Dias, J. M. M. (2023) · International Conference on Advanced Robotics (ICAR) · doi:10.1109/icar58858.2023.10436500 · Cited by 3 · see citing works
Visual-Inertial Features Fusion for Pose Estimation
Wang, Y., & Xu, X. (2024) · Chinese Control Conference (CCC) · doi:10.23919/ccc63176.2024.10661761 · Cited by 3 · see citing works
LPL-VIO: monocular visual-inertial odometry with deep learning-based point and line features
Liu, C., Yang, Q., Yu, H., Fu, Q., & Akhtar, N. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10294-z · Cited by 3 · see citing works
Fault Resistant Odometry Estimation using Message Passing Neural Network
Dahal, P., Mentasti, S., Paparusso, L., Arrigoni, S., & Braghin, F. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186649 · Cited by 3 · see citing works
Wang, Z., Yang, S., Shi, M., & Qin, K. (2022) · Electronics · doi:10.3390/electronics11020223 · Cited by 3 · see citing works
Right Invariant SE2 (3) - EKF for Relative Navigation in Learning-based Visual Inertial Odometry
Luo, Y., Hu, J., & Guo, C. (2022) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/isas55863.2022.9757054 · Cited by 3 · see citing works
DeepWavelet: A Multimodal Wavelet-Based Network for Sonar–Inertial Odometry in Underwater Robots
Bai, J., Zhu, D., & Chen, M. (2025) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2025.3630404 · Cited by 2 · see citing works
Robust Visual-Inertial Odometry Based on Deep Learning and Extended Kalman Filter
Zuo, S., Shen, K., & Zuo, J. (2021) · China Automation Congress (CAC) · doi:10.1109/cac53003.2021.9727349 · Cited by 2 · see citing works
Yu, Z. (2024) · Applied Intelligence · doi:10.1007/s10489-024-06120-7 · Cited by 2 · see citing works
Fusing Multi-sensor Input with State Information on TinyML Brains for Autonomous Nano-drones
Crupi, L., Cereda, E., & Palossi, D. (2024) · Springer proceedings in advanced robotics · doi:10.1007/978-3-031-76424-0_53 · Cited by 2 · see citing works
NOCaL: Calibration-Free Semi-Supervised Learning of Odometry and Camera Intrinsics
Griffiths, R., Naylor, J., & Dansereau, D. G. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160663 · Cited by 1 · see citing works
Neural Ranging Inertial Odometry
Wang, S., Shen, B., Wang, F., Cao, Y., Xiong, R., & Wang, Y. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128550 · Cited by 1 · see citing works
Zhang, J., Wang, P., Li, Y., Song, Q., & Fu, L. (2025) · Measurement · doi:10.1016/j.measurement.2025.119442 · Cited by 1 · see citing works
TSFNet: A Two-Stage Fusion Network for Visual–Inertial Odometry
Wang, S., Liang, Y., Lin, J., Gan, Y., Zhong, M., Yin, X., & Bao, P. (2025) · Mathematics · doi:10.3390/math13233842 · Cited by 1 · see citing works
SS-VIO: A Novel Cross Modal State Space Visual Inertial Odometry
Qin, W., Lin, Z., Bai, L., Yao, S.-J., Xu, H., & Dong, X. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3643327 · Cited by 1 · see citing works
Deng, Y., Tian, L., Hou, X., Liu, X., Wang, Y., Liu, X., & Liao, C. (2026) · Sensors · doi:10.3390/s26020711 · Cited by 1 · see citing works
Localization for car-like vehicles using loosely coupled dual-GNSS integration
Souza, V., Gaspar, J. A., Fernandes, J. F. P., & Bernardino, A. J. M. (2026) · Discover Vehicles · doi:10.1007/s44465-026-00004-5 · Cited by 1 · see citing works
- Authors
- Han, L., Lin, Y., Du, G., & Lian, S.
- Affiliations
- CloudMinds Technologies Inc,AI Department,Beijing,China,100102
- Venue
- 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2019-11
- Pages
- 6906-6913
- ISSN
- 2153-0858 (ISSN-L)
- OpenAlex
- W3003233851
- Cited by
- 125
- References
- 35
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 19 · 2023: 27 · 2022: 17 · 2021: 14 · 2020: 8 · 2019: 3
- FWCI
- 19.04
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Keywords
- self-supervised learning, 3D optical flow, IMU pre-integration, IMU bias estimation, sensor fusion, stereo vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
