The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
BAD SLAM: Bundle Adjusted Direct RGB-D SLAM
Abstract
A key component of Simultaneous Localization and Mapping (SLAM) systems is the joint optimization of the estimated 3D map and camera trajectory. Bundle adjustment (BA) is the gold standard for this. Due to the large number of variables in dense RGB-D SLAM, previous work has focused on approximating BA. In contrast, in this paper we present a novel, fast direct BA formulation which we implement in a real-time dense RGB-D SLAM algorithm. In addition, we show that direct RGB-D SLAM systems are highly sensitive to rolling shutter, RGB and depth sensor synchronization, and calibration errors. In order to facilitate state-of-the-art research on direct RGB-D SLAM, we propose a novel, well-calibrated benchmark for this task that uses synchronized global shutter RGB and depth cameras. It includes a training set, a test set without public ground truth, and an online evaluation service. We observe that the ranking of methods changes on this dataset compared to existing ones, and our proposed algorithm outperforms all other evaluated SLAM methods. Our benchmark and our open source SLAM algorithm are available at: www.eth3d.net
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898 · cited 5×
“Results for other methods are as reported in [7], [70] and [44].”
MethodInfluentialStructure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
Self-citationBRIEF: Binary Robust Independent Elementary Features
Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_56 · Cited by 3,597
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Least-squares estimation of transformation parameters between two point patterns
Umeyama, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.88573 · Cited by 2,420
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 1×
“Direct [10, 45, 46, 69] approaches can make use of all data.”
BackgroundThe EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066
Bags of Binary Words for Fast Place Recognition in Image Sequences
Galvez-López, D., & Tardos, J. D. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2197158 · Cited by 1,913
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911434148 · Cited by 1,161
Real-time 3D reconstruction at scale using voxel hashing
Nießner, M., Zollhöfer, M., Izadi, S., & Stamminger, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508374 · Cited by 1,002
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos
Schops, T., Schonberger, J. L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.272 · Cited by 915
Self-citationDense visual SLAM for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696650 · Cited by 909
A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM
Handa, A., Whelan, T., McDonald, J., & Davison, A. J. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907054 · Cited by 906
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
An evaluation of the RGB-D SLAM system
Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., & Burgard, W. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225199 · Cited by 731
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3054739 · Cited by 662
Robust reconstruction of indoor scenes
Choi, S., Zhou, Q.-Y., & Koltun, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299195 · Cited by 555
Vidal, A. R., Rebecq, H., Horstschaefer, T., & Scaramuzza, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793357 · Cited by 541
The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
Schubert, D., Goll, T., Demmel, N., Usenko, V., Stuckler, J., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593419 · Cited by 473
Joint Depth and Color Camera Calibration with Distortion Correction
Herrera C., D., Kannala, J., & Heikkila, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.125 · Cited by 453
Intel(R) RealSense(TM) Stereoscopic Depth Cameras
Keselman, L., Woodfill, J. I., Grunnet-Jepsen, A., & Bhowmik, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.167 · Cited by 448
Richter, S. R., Hayder, Z., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.243 · Cited by 419
Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion
Keller, M., Lefloch, D., Lambers, M., Izadi, S., Weyrich, T., & Kolb, A. (2013) · 2013 International Conference on 3D Vision · doi:10.1109/3dv.2013.9 · Cited by 384
State of the Art on 3D Reconstruction with RGB‐D Cameras
Zollhöfer, M., Stotko, P., Görlitz, A., Theobalt, C., Nießner, M., Klein, R., & Kolb, A. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13386 · Cited by 339
Colored Point Cloud Registration Revisited
Park, J., Zhou, Q.-Y., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.25 · Cited by 331
LDSO: Direct Sparse Odometry with Loop Closure
Gao, X., Wang, R., Demmel, N., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593376 · Cited by 327
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3054739 · Cited by 258
Variable baseline/resolution stereo
Gallup, D., Frahm, J., Mordohai, P., & Pollefeys, M. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587671 · Cited by 245
Self-citationAccurate Camera Calibration from Multi-View Stereo and Bundle Adjustment
Furukawa, Y., & Ponce, J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0232-2 · Cited by 223
InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes DatasetPreprint
Li, W., Sajad Saeedi, G., McCormac, J., Clark, R., Tzoumanikas, D., Ye, Q., Huang, Y., Tang, R., & Leutenegger, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00716 · Cited by 210
Multi-resolution surfel maps for efficient dense 3D modeling and tracking
Stückler, J., & Behnke, S. (2014) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2013.02.008 · Cited by 209
A Photometrically Calibrated Benchmark For Monocular Visual OdometryPreprint
Engel, J. J., Usenko, V., & Cremers, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02555 · Cited by 209
Real-Time Large-Scale Dense 3D Reconstruction with Loop Closure
Kähler, O., Prisacariu, V. A., & Murray, D. W. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_30 · Cited by 132
Konolige, K. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509796 · Cited by 127
ActiveStereoNet: End-to-End Self-supervised Learning for Active Stereo Systems
Zhang, Y., Khamis, S., Rhemann, C., Valentin, J., Kowdle, A., Tankovich, V., Schoenberg, M., Izadi, S., Funkhouser, T. A., & Fanello, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_48 · Cited by 124
On unifying key-frame and voxel-based dense visual SLAM at large scales
Meilland, M., & Comport, A. I. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696881 · Cited by 103
Photometric Bundle Adjustment for Dense Multi-view 3D Modeling
Delaunoy, A., & Pollefeys, M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.193 · Cited by 97
Self-citationIllumination change robustness in direct visual SLAM
Park, S., Schöps, T., & Pollefeys, M. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989525 · Cited by 94
Self-citationCoRBS: Comprehensive RGB-D benchmark for SLAM using Kinect v2
Wasenmüller, O., Meyer, M., & Stricker, D. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477636 · Cited by 93
Hierarchical Voxel Block Hashing for Efficient Integration of Depth Images
Kähler, O., Prisacariu, V. A., Valentin, J., & Murray, D. W. (2015) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2015.2512958 · Cited by 74
Photometric Bundle Adjustment for Vision-Based SLAM
Alismail, H., Brett Browning, A., & Lucey, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54190-7_20 · Cited by 71
A Super-Resolution Framework for High-Accuracy Multiview Reconstruction
Goldlüecke, B., Aubry, M., Kolev, K., & Cremers, D. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0654-8 · Cited by 66
Large-scale and drift-free surface reconstruction using online subvolume registration
Fioraio, N., Taylor, J., Fitzgibbon, A. W., Stefano, L. D., & Izadi, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299077 · Cited by 60
3D High Dynamic Range dense visual SLAM and its application to real-time object re-lighting
Meilland, M., Barat, C., & Comport, A. I. (2013) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2013.6671774 · Cited by 58
Accurate and Automatic Alignment of Range Surfaces
Fantoni, S., Castellani, U., & Fusiello, A. (2012) · International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission · doi:10.1109/3dimpvt.2012.63 · Cited by 53
Dense Visual SLAM with Probabilistic Surfel Map
Yan, Z., Ye, M., & Ren, L. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2734458 · Cited by 52
Online loop closure for real-time interactive 3D scanning
Weise, T., Wismer, T., Leibe, B., & Gool, L. V. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.11.023 · Cited by 51
SDF-2-SDF: Highly Accurate 3D Object Reconstruction
Slavcheva, M., Kehl, W., Navab, N., & Ilić, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_41 · Cited by 44
Comprehensive Use of Curvature for Robust and Accurate Online Surface Reconstruction
Lefloch, D., Kluge, M., Sarbolandi, H., Weyrich, T., & Kolb, A. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2648803 · Cited by 39
A Unified Rolling Shutter and Motion Blur Model for 3D Visual Registration
Meilland, M., Drummond, T. W., & Comport, A. I. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.252 · Cited by 36
Real-time Dense Visual Tracking under Large Lighting Variations
Meilland, M., Comport, A. I., & Rives, P. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.45 · Cited by 35
Structureless pose-graph loop-closure with a multi-camera system on a self-driving car
Lee, G. H., Fraundorfer, F., & Pollefeys, M. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696407 · Cited by 35
Self-citationOmnidirectional visual obstacle detection using embedded FPGA
Gohl, P., Honegger, D., Omari, S., Achtelik, M., Pollefeys, M., & Siegwart, R. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353931 · Cited by 34
Self-citationSparse to Dense 3D Reconstruction from Rolling Shutter Images
Saurer, O., Pollefeys, M., & Lee, G. H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.363 · Cited by 34
Self-citationDegeneracies in Rolling Shutter SfM
Albl, Č., Sugimoto, A., & Pajdla, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_3 · Cited by 32
Super-resolution 3D tracking and mapping
Meilland, M., & Comport, A. I. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6631399 · Cited by 31
Online Reconstruction of Indoor Scenes from RGB-D Streams
Wang, H., Wang, J., & Wang, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.356 · Cited by 23
Scan rectification for structured light range sensors with rolling shutters
Ringaby, E., & Forssén, P.-E. (2011) · International Conference on Computer Vision · doi:10.1109/iccv.2011.6126417 · Cited by 13
Cited by
NICE-SLAM: Neural Implicit Scalable Encoding for SLAM
Zhu, Z., Peng, S., Larsson, V., Xu, W., Bao, H., Cui, Z., Oswald, M. R., & Pollefeys, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01245 · Cited by 825
Self-citationiMAP: Implicit Mapping and Positioning in Real-Time
Sucar, E., Liu, S., Ortiz, J., & Davison, A. J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00617 · Cited by 670
Choy, C., Dong, W., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00259 · Cited by 548
Matsuki, H., Murai, R., Kelly, P. H. J., & Davison, A. J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01708 · Cited by 493
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Keetha, N., Karhade, J., Jatavallabhula, K. M., Yang, G., Scherer, S., Ramanan, D., & Luiten, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02018 · Cited by 462
Metadata
- Authors
- Schops, T., Sattler, T., & Pollefeys, M.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 134-144
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2951730755
- Cited by
- 383
- References
- 67
- FWCI
- 52.84
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.