Direct Visual SLAM Using Sparse Depth for Camera-LiDAR System
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
This paper describes a framework for direct visual simultaneous localization and mapping (SLAM) combining a monocular camera with sparse depth information from Light Detection and Ranging (LiDAR). To ensure realtime performance while maintaining high accuracy in motion estimation, we present (i) a sliding window-based tracking method, (ii) strict pose marginalization for accurate pose-graph SLAM and (iii) depth-integrated frame matching for large-scale mapping. Unlike conventional feature-based visual and LiDAR mapping, the proposed approach is direct, eliminating the visual feature in the objective function. We evaluated results using our portable camera-LiDAR system as well as KITTI odometry benchmark datasets. The experimental results prove that the characteristics of two complementary sensors are very effective in improving real-time performance and accuracy. Via validation, we achieved low drift error of 0.98 % in the KITTI benchmark including various environments such as a highway and residential areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778 · cited 2×
“A number of studies have been aimed at motion estimation using cameras [12]–[15].”
BackgroundMethodParallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 3×
“Instead of using a feature-based reprojection error model, they mainly use a photometric error model that considers the intensity difference of a pixel [4]–[6], [9], [16].”
BackgroundMethodSVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 2×
“Instead of using a feature-based reprojection error model, they mainly use a photometric error model that considers the intensity difference of a pixel [4]–[6], [9], [16].”
MethodREMODE: Probabilistic, monocular dense reconstruction in real time
Pizzoli, M., Forster, C., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907233 · Cited by 330 · cited 2×
“Instead of using a feature-based reprojection error model, they mainly use a photometric error model that considers the intensity difference of a pixel [4]–[6], [9], [16].”
MethodDouble window optimisation for constant time visual SLAM
Strasdat, H., Davison, A. J., Montiel, J. M. M., & Konolige, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126517 · Cited by 296
Cited by
A Review of Visual-LiDAR Fusion based Simultaneous Localization and Mapping
Debeunne, C., & Vivet, D. (2020) · Sensors · doi:10.3390/s20072068 · Cited by 386
Multimodal end-to-end autonomous driving
Xiao, Y., Codevilla, F., Gurram, A., Urfalioglu, O., & Lopez, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3013234 · Cited by 319
A Review of Multi-Sensor Fusion SLAM Systems Based on 3D LIDAR
Xu, X., Zhang, L., Yang, J., Cao, C., Wang, W., Ran, Y., Tan, Z., & Luo, M. (2022) · Remote Sensing · doi:10.3390/rs14122835 · Cited by 302
Lic-fusion: Lidar-inertial-camera odometry
Zuo, X., Geneva, P., Lee, W., Liu, Y., & Huang, G. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967746 · Cited by 222
“Shin, Park, and Kim [15] have used the depth from LiDAR in a direct visual SLAM method, where photometric errors were minimized in an iterative way.”
MethodA review of research on slam technology based on the fusion of lidar and vision
Chen, P., Zhao, X., Zeng, L., Liu, L., Liu, S., Sun, L., Li, Z., Chen, H., Liu, G., Qiao, Z., et al. (2025) · Sensors · doi:10.3390/s25051447 · Cited by 46
“For instance, Young-Sik Shin et al. (2018)’s direct-vision SLAM method combining sparse depth information shows that integrating LiDAR and vision camera data can enhance accuracy and real-time performance [5].”
Metadata
- Authors
- Shin, Y.-S., Park, Y. S., & Kim, A.
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 5144-5151
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2891031479
- Cited by
- 115
- References
- 7
- FWCI
- 21.96
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.