The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
StereoScan: Dense 3d reconstruction in real-time
Abstract
Accurate 3d perception from video sequences is a core subject in computer vision and robotics, since it forms the basis of subsequent scene analysis. In practice however, online requirements often severely limit the utilizable camera resolution and hence also reconstruction accuracy. Furthermore, real-time systems often rely on heavy parallelism which can prevent applications in mobile devices or driver assistance systems, especially in cases where FPGAs cannot be employed. This paper proposes a novel approach to build 3d maps from high-resolution stereo sequences in real-time. Inspired by recent progress in stereo matching, we propose a sparse feature matcher in conjunction with an efficient and robust visual odometry algorithm. Our reconstruction pipeline combines both techniques with efficient stereo matching and a multi-view linking scheme for generating consistent 3d point clouds. In our experiments we show that the proposed odometry method achieves state-of-the-art accuracy. Including feature matching, the visual odometry part of our algorithm runs at 25 frames per second, while - at the same time - we obtain new depth maps at 3-4 fps, sufficient for online 3d reconstructions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“…there exists a large body of related work, sketched briefly in the following: Simultaneous Localisation and Mapping (SLAM) [6], [19], [7], [26], [5] is the process by which a mobile robot incrementally builds a consistent map of its environment and at the same time uses this map to compute its…”
BackgroundA solution to the simultaneous localization and map building (SLAM) problem
Dissanayake, M. W. M. G., Newman, P., Clark, S., Durrant-Whyte, H. F., & Csorba, M. (2001) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.938381 · Cited by 2,661
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457
Efficient Non-Maximum Suppression
Neubeck, A., & Van Gool, L. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.479 · Cited by 2,118
Triangle: Engineering a 2D quality mesh generator and Delaunay triangulator
Shewchuk, J. R. (1996) · Lecture Notes in Computer Science · doi:10.1007/bfb0014497 · Cited by 2,115
FastSLAM: a factored solution to the simultaneous localization and mapping problem
Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2002) · doi:10.5555/777092.777184 · Cited by 2,012
Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S. M., & Szeliski, R. (2011) · Communications of the ACM · doi:10.1145/2001269.2001293 · Cited by 1,072
Agarwal, S., Snavely, N., Simon, I., Seitz, S. M., & Szeliski, R. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459148 · Cited by 1,067
Visual Modeling with a Hand-Held Camera
Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., & Koch, R. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000025798.50602.3a · Cited by 874
Research works printed but not linked: 1
- durrant-whyte, 2006, Simultaneous localisation and mapping, IEEE Robotics and Automation magazine, 2, 2006
Cited by
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Self-citationA Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
Object scene flow for autonomous vehicles
Menze, M., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298925 · Cited by 2,270
Self-citation1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632
Labbé, M., & Michaud, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21831 · Cited by 989
Deepvo: towards end-to-end visual odometry with deep recurrent convolutional neural networks
Wang, S., Clark, R., Wen, H., & Trigoni, N. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989236 · Cited by 970
“1, employ multi-view geometry [5] to determine motion after extracting and matching (or tracking) salient feature points from a sequence of images, such as the algorithm in [6] and LIBVISO2 [7].”
MethodA Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos
Schops, T., Schonberger, J. L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.272 · Cited by 915
Self-citationSimultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
“Karlsruhe sequences [103] 2011 √ √ √ ✗ Stereo: b/w 1344 × 391@ 10 fps 6.”
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Self-citationDense Contrastive Learning for Self-Supervised Visual Pre-Training
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00304 · Cited by 660
Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Sun, K., Mohta, K., Pfrommer, B., Watterson, M., Liu, S., Mulgaonkar, Y., Taylor, C. J., & Kumar, V. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793349 · Cited by 539
Probabilistic data association for semantic SLAM
Bowman, S. L., Atanasov, N., Daniilidis, K., & Pappas, G. J. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989203 · Cited by 462
Visual SLAM and Structure from Motion in Dynamic Environments: A Survey
Saputra, M. R. U., Markham, A., & Trigoni, N. (2019) · ACM Computing Surveys · doi:10.1145/3177853 · Cited by 398
3D Traffic Scene Understanding From Movable Platforms
Geiger, A., Lauer, M., Wojek, C., Stiller, C., & Urtasun, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.185 · Cited by 397
Self-citationJOINT 3D ESTIMATION OF VEHICLES AND SCENE FLOW
Menze, M., Heipke, C., & Geiger, A. (2015) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsannals-ii-3-w5-427-2015 · Cited by 341
Self-citationThe Málaga urban dataset: High-rate stereo and LiDAR in a realistic urban scenario
Blanco-Claraco, J.-L., Moreno-Dueñas, F.-Á., & González-Jiménez, J. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364913507326 · Cited by 262
Limo: Lidar-monocular visual odometry
Graeter, J., Wilczynski, A., & Lauer, M. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594394 · Cited by 261
Exploring Representation Learning With CNNs for Frame-to-Frame Ego-Motion Estimation
Costante, G., Mancini, M., Valigi, P., & Ciarfuglia, T. A. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2015.2505717 · Cited by 203
Visual Odometry Revisited: What Should Be Learnt?
Zhan, H., Weerasekera, C. S., Bian, J.-W., & Reid, I. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197374 · Cited by 201
A Review of SLAM Techniques and Security in Autonomous Driving
Singandhupe, A., & La, H. M. (2019) · 2019 Third IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00122 · Cited by 147
Deep learning-based spacecraft relative navigation methods: A survey
Song, J., Rondao, D., & Aouf, N. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2021.10.025 · Cited by 106
“12 deg per trajectory for position and attitude, respectively, on lengths of 100 m–800 m, showing a competitive performance relative to Monocular VISO2 [14].”
BackgroundInfluentialVisual Navigation Using Heterogeneous Landmarks and Unsupervised Geometric Constraints
Lu, Y., & Song, D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2424032 · Cited by 103
Deep Learning for Visual Localization and Mapping: A Survey
Chen, C., Wang, B., Lu, C. X., Trigoni, N., & Markham, A. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3309809 · Cited by 97
Multi-modal Auto-Encoders as Joint Estimators for Robotics Scene Understanding
Cadena, C., Dick, A., & D. Reid, I. (2016) · Robotics: Science and Systems XII · doi:10.15607/rss.2016.xii.041 · Cited by 93
Ditto: Building Digital Twins of Articulated Objects from Interaction
Jiang, Z., Hsu, C.-C., & Zhu, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00553 · Cited by 92
“Research on 3D vision and SLAM [3,13,36,37,56] has made significant advances in capturing realistic objects and scenes with static 3D models.”
BackgroundUnsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery
Shamwell, E. J., Lindgren, K., Leung, S., & Nothwang, W. D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2909895 · Cited by 86
“…Zhan et al. [30] (results reproduced from [30]) VINet [2] (results reproduced from [2]) UnDeepVO [35] (results reproduced from [35]) VISO2 (Mono) [50] (results reproduced from [35]) ORB-SLAM (Mono) [15] (results reproduced from [34]) ORB-SLAM2 (Stereo) [20] EKF+VISO2 (results reproduced from…”
Yin, H., & Berger, C. (2017) · 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317828 · Cited by 79
Omnidirectional 3D reconstruction in augmented Manhattan worlds
Schonbein, M., & Geiger, A. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942637 · Cited by 63
Self-citationSengupta, S., & Sturgess, P. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139442 · Cited by 54
DF-VO: What Should Be Learnt for Visual Odometry?
Zhan, H., Weerasekera, C. S., Bian, J.-W., Garg, R., & Reid, I. (2021) · arXiv · doi:10.48550/arxiv.2103.00933 · Cited by 31
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161431 · Cited by 21
“Recent advances in structure sensors and SLAM algorithms [9, 29, 30] have offered ways to construct static replicas of realworld scenes at unprecedented fidelity.”
BackgroundPROBE-GK: Predictive robust estimation using generalized kernels
Peretroukhin, V., Vega-Brown, W., Roy, N., & Kelly, J. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487212 · Cited by 17
Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach
Françani, A. O., & Maximo, M. R. O. A. (2023) · arXiv · doi:10.48550/arxiv.2305.06121 · Cited by 38
“LIBVISO2 [15] is a known implementation of the traditional pipeline for the monocular and stereo cases.”
Metadata
- Authors
- Geiger, A., Ziegler, J., & Stiller, C.
- Venue
- 2011 IEEE Intelligent Vehicles Symposium (IV)
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 963-968
- ISSN
- 1931-0587 (ISSN-L)
- OpenAlex
- W2168676389
- Cited by
- 1,089
- References
- 26
- FWCI
- 37.31
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.