Dense visual SLAM for RGB-D cameras
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
In this paper, we propose a dense visual SLAM method for RGB-D cameras that minimizes both the photometric and the depth error over all pixels. In contrast to sparse, feature-based methods, this allows us to better exploit the available information in the image data which leads to higher pose accuracy. Furthermore, we propose an entropy-based similarity measure for keyframe selection and loop closure detection. From all successful matches, we build up a graph that we optimize using the g2o framework. We evaluated our approach extensively on publicly available benchmark datasets, and found that it performs well in scenes with low texture as well as low structure. In direct comparison to several state-of-the-art methods, our approach yields a significantly lower trajectory error. We release our software as open-source.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Simultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199 · cited 1×
“an extended Kalman filter [25], [26], and incrementally refine them.”
MethodKinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008 · cited 7×
“As KinectFusion does not optimize previous camera poses, there is no possibility to correct accumulated errors in the model.”
BackgroundMethodInfluentialA benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
Self-citationMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
Efficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 1×
“proposed to incrementally build a dense model of the scene and registering every new measurement to this model [5], [23].”
BackgroundG2o: A general framework for graph optimization
Kummerle, R., Grisetti, G., Strasdat, H., Konolige, K., & Burgard, W. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979949 · Cited by 1,982
Globally Consistent Range Scan Alignment for Environment Mapping
Lu, F., & Milios, E. (1997) · Autonomous Robots · doi:10.1023/a:1008854305733 · Cited by 1,304
Nistér, D., Naroditsky, O., & Bergen, J. R. (2004) · Cited by 1,169
Nister, D., Naroditsky, O., & Bergen, J. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315094 · Cited by 1,030
RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
An evaluation of the RGB-D SLAM system
Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., & Burgard, W. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225199 · Cited by 731
Self-citationKintinuous: Spatially Extended KinectFusion
Whelan, T. J., Kaess, M., Fallon, M. F., Johannsson, H., Leonard, J. J., & McDonald, J. (2012) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 624
Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera
Huang, A. S., Bachrach, A., Henry, P., Krainin, M., Maturana, D., Fox, D., & Roy, N. (2017) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-29363-9_14 · Cited by 603
Incremental mapping of large cyclic environments
Gutmann, J.-S., & Konolige, K. (2003) · Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375) · doi:10.1109/cira.1999.810068 · Cited by 568 · cited 1×
“Pose SLAM does not optimize the scene structure in conjunction with the sensor poses, but only optimizes the sensor poses [29], [30].”
BackgroundRobust odometry estimation for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631104 · Cited by 542
Self-citationA stochastic map for uncertain spatial relationships
Smith, R. K., Self, M. W., & Cheeseman, P. C. (1988) · Cited by 425
Real-time visual odometry from dense RGB-D images
Steinbrucker, F., Sturm, J., & Cremers, D. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130321 · Cited by 364
Self-citationRobust real-time visual odometry for dense RGB-D mapping
Whelan, T., Johannsson, H., Kaess, M., Leonard, J. J., & McDonald, J. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631400 · Cited by 344
Scale Drift-Aware Large Scale Monocular SLAM
Strasdat, H., M. M. Montiel, J., & Davison, A. (2010) · Robotics: Science and Systems VI · doi:10.15607/rss.2010.vi.010 · Cited by 323
Scale Drift-Aware Large Scale Monocular SLAM
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2011) · Robotics · doi:10.7551/mitpress/9123.003.0014 · Cited by 320
Real-time 3D visual SLAM with a hand-held camera
Engelhard, N., Endres, F., Hess, J., Sturm, J., & Burgard, W. (2011) · Cited by 268
Self-citationOutdoor Mapping and Navigation Using Stereo Vision
Konolige, K., Agrawal, M., Bolles, R. C., Cowan, C., Fischler, M., & Gerkey, B. (2008) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-540-77457-0_17 · Cited by 190
Accurate Quadrifocal Tracking for Robust 3D Visual Odometry
Comport, A. I., Malis, E., & Rives, P. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.363762 · Cited by 175
Optimal Structure from Motion: Local Ambiguities and Global Estimates
Chiuso, A., Brockett, R. W., & Soatto, S. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026563712076 · Cited by 111
Direct Iterative Closest Point for real-time visual odometry
Tykkälä, T., Audras, C., & Comport, A. I. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130500 · Cited by 110
Integrating depth and color cues for dense multi-resolution scene mapping using RGB-D cameras
Stückler, J., & Behnke, S. (2012) · IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) · doi:10.1109/mfi.2012.6343050 · Cited by 62
3-D Motion and Structure from 2-D Motion Causally Integrated over Time: Implementation
Chiuso, A., Favaro, P., Jin, H., & Soatto, S. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45053-x_47 · Cited by 57
A Memory-Efficient KinectFusion Using Octree
Zeng, M., Zhao, F., Zheng, J., & Liu, X. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34263-9_30 · Cited by 56
Stereo tracking using ICP and normal flow constraint
Morency, L., & Darrell, T. (2003) · doi:10.1109/icpr.2002.1047472 · Cited by 44
Dense visual mapping of large scale environments for real-time localisation
Meilland, M., Comport, A. I., & Rives, P. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094703 · Cited by 37
FAB-MAP: Appearance-Based Place Recognition and Mapping using a Learned Visual Vocabulary Model
Cummins, M., & Newman, P. M. (2010) · International Conference on Machine Learning · Cited by 35
Live RGB-D camera tracking for television production studios
Tykkälä, T., Comport, A. I., Kämäräinen, J., & Hartikainen, H. (2013) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2013.02.009 · Cited by 16
Cited by
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
“In Table III we compare our accuracy to the following state-of-the-art methods: ElasticFusion [15], Kintinuous [12], DVO-SLAM [14] and RGB-D SLAM [13].”
MethodInfluentialLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
Self-citationFAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Xu, W., Cai, Y., He, D., Lin, J., & Zhang, F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3141876 · Cited by 1,750
Labbé, M., & Michaud, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21831 · Cited by 989
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
Metadata
- Authors
- Kerl, C., Sturm, J., & Cremers, D.
- Venue
- 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems
- Publisher
- IEEE
- Published
- 2013-11
- Pages
- 2100-2106
- OpenAlex
- W2064451896
- Cited by
- 909
- References
- 38
- FWCI
- 84.36
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.