The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Open accessAbstract
Direct methods for visual odometry (VO) have gained popularity for their capability to exploit information from all intensity gradients in the image. However, low computational speed as well as missing guarantees for optimality and consistency are limiting factors of direct methods, in which established feature-based methods succeed instead. Based on these considerations, we propose a semidirect VO (SVO) that uses direct methods to track and triangulate pixels that are characterized by high image gradients, but relies on proven feature-based methods for joint optimization of structure and motion. Together with a robust probabilistic depth estimation algorithm, this enables us to efficiently track pixels lying on weak corners and edges in environments with little or high-frequency texture. We further demonstrate that the algorithm can easily be extended to multiple cameras, to track edges, to include motion priors, and to enable the use of very large field of view cameras, such as fisheye and catadioptric ones. Experimental evaluation on benchmark datasets shows that the algorithm is significantly faster than the state of the art while achieving highly competitive accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
(1981) · Cited by 11,963
Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
Lucas-Kanade 20 Years On: A Unifying Framework
Baker, S., & Matthews, I. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011205.11775.fd · Cited by 3,155
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Shape and motion from image streams under orthography: a factorization method
Tomasi, C., & Kanade, T. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,878
Least-squares estimation of transformation parameters between two point patterns
Umeyama, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.88573 · Cited by 2,420
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Self-citationDTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 3×
“When a depth filter’s uncertainty becomes small enough, a new 3D point is inserted in the map and is immediately used for motion estimation.”
BackgroundMethodInfluentialAn efficient solution to the five-point relative pose problem
Nister, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.17 · Cited by 2,009
G2o: A general framework for graph optimization
Kummerle, R., Grisetti, G., Strasdat, H., Konolige, K., & Burgard, W. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979949 · Cited by 1,982
Faster and Better: A Machine Learning Approach to Corner Detection
Rosten, E., Porter, R., & Drummond, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.275 · Cited by 1,849
The Interpretation of Visual Motion
Burt, P. J., & Ullman, S. (1980) · The American Journal of Psychology · doi:10.2307/1422246 · Cited by 1,760
The Interpretation of Visual Motion
Ullman, S. (1979) · The MIT Press eBooks · doi:10.7551/mitpress/3877.001.0001 · Cited by 1,644
Scaramuzza, D., & Fraundorfer, F. (2011) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2011.943233 · Cited by 1,550
Self-citationiSAM2: Incremental smoothing and mapping using the Bayes tree
Kaess, M., Johannsson, H., Roberts, R., Ila, V., Leonard, J. J., & Dellaert, F. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911430419 · Cited by 1,362
Nister, D., Naroditsky, O., & Bergen, J. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315094 · Cited by 1,030
Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing
Dellaert, F., & Kaess, M. (2006) · The International Journal of Robotics Research · doi:10.1177/0278364906072768 · Cited by 922
A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM
Handa, A., Whelan, T., McDonald, J., & Davison, A. J. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907054 · Cited by 906
An Invitation to 3-D Vision: From Images to Geometric Models
Ma, Y., Soatto, S., Koseck, J., & Sastry, S. (2003) · Cited by 846
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
Unified temporal and spatial calibration for multi-sensor systems
Furgale, P., Rehder, J., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696514 · Cited by 807
Inverse Depth Parametrization for Monocular SLAM
Civera, J., Davison, A. J., & Montiel, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2003276 · Cited by 779
An evaluation of the RGB-D SLAM system
Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., & Burgard, W. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225199 · Cited by 731
Two years of Visual Odometry on the Mars Exploration Rovers
Maimone, M., Cheng, Y., & Matthies, L. (2007) · Journal of Field Robotics · doi:10.1002/rob.20184 · Cited by 655 · cited 1×
“, in scenes with little or high-frequency texture (such as sand [12] or asphalt [13]), is increased when the algorithm is not restricted to use local point features (e.”
BackgroundReal-time visual tracking of complex structures
Drummond, T., & Cipolla, R. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017620 · Cited by 598
An invitation to 3‐d vision: from images to geometric models
Holmgren, D. E. (2004) · The Photogrammetric Record · doi:10.1111/j.0031-868x.2004.295_2.x · Cited by 558
Robust odometry estimation for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631104 · Cited by 542
Semi-dense Visual Odometry for a Monocular Camera
Engel, J., Sturm, J., & Cremers, D. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.183 · Cited by 517
A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion
Scaramuzza, D., Martinelli, A., & Siegwart, R. (2006) · Fourth IEEE International Conference on Computer Vision Systems (ICVS'06) · doi:10.1109/icvs.2006.3 · Cited by 417
Self-citationGoing out: robust model-based tracking for outdoor augmented reality
Reitmayr, G., & Drummond, T. (2006) · 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2006.297801 · Cited by 388
Improving the Agility of Keyframe-Based SLAM
Klein, G., & Murray, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_59 · Cited by 335
REMODE: Probabilistic, monocular dense reconstruction in real time
Pizzoli, M., Forster, C., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907233 · Cited by 330 · cited 3×
“When a depth filter’s uncertainty becomes small enough, a new 3D point is inserted in the map and is immediately used for motion estimation.”
BackgroundMethodSelf-citationStructure from motion causally integrated over time
Chiuso, A., Favaro, P., Jin, H., & Soatto, S. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993559 · Cited by 324
Observability-based Rules for Designing Consistent EKF SLAM Estimators
Huang, G. P., Mourikis, A. I., & Roumeliotis, S. I. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364909353640 · Cited by 272
A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM
Nikolic, J., Rehder, J., Burri, M., Gohl, P., Leutenegger, S., Furgale, P. T., & Siegwart, R. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906892 · Cited by 270
Combining Edge and Texture Information for Real-Time Accurate 3D Camera Tracking
Vacchetti, L., Lepetit, V., & Fua, P. (2005) · Third IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2004.24 · Cited by 262
Irani, M., & Anandan, P. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_18 · Cited by 250
Autonomous, Vision‐based Flight and Live Dense 3D Mapping with a Quadrotor Micro Aerial Vehicle
Faessler, M., Fontana, F., Forster, C., Mueggler, E., Pizzoli, M., & Scaramuzza, D. (2016) · Journal of Field Robotics · doi:10.1002/rob.21581 · Cited by 247
Self-citationBenefit of large field-of-view cameras for visual odometry
Zhang, Z., Rebecq, H., Förster, C., & Scaramuzza, D. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487210 · Cited by 171
Self-citationReal-time feature tracking and outlier rejection with changes in illumination
Jin, H., Favaro, P., & Soatto, S. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937588 · Cited by 158
A real-time tracker for markerless augmented reality
Comport, A. I., Marchand, É., & Chaumette, F. (2003) · doi:10.5555/946248.946787 · Cited by 157
Video-based, real-time multi-view stereo
Vogiatzis, G., & Hernández, C. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.01.006 · Cited by 154
An Efficient Direct Approach to Visual SLAM
Silveira, G., Malis, E., & Rives, P. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004829 · Cited by 153
Real-time Quadrifocal Visual Odometry
Comport, A. I., Malis, E., & Rives, P. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364909356601 · Cited by 132
MobileFusion: Real-Time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones
Ondrúška, P., Kohli, P., & Izadi, S. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2459902 · Cited by 122
Locally Planar Patch Features for Real-Time Structure from Motion
Molton, N., Davison, A. J., & Reid, I. D. (2004) · British Machine Vision Conference (BMVC) · doi:10.5244/c.18.90 · Cited by 121
A real-time tracker for markerless augmented reality
Comport, A. I., Marchand, É., & Chaumette, F. (2004) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2003.1240686 · Cited by 111
At all Costs: A Comparison of Robust Cost Functions for Camera Correspondence Outliers
MacTavish, K., & Barfoot, T. D. (2015) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2015.52 · Cited by 103
On unifying key-frame and voxel-based dense visual SLAM at large scales
Meilland, M., & Comport, A. I. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696881 · Cited by 103
Förster, C., Faessler, M., Fontana, F., Werlberger, M., & Scaramuzza, D. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7138988 · Cited by 102
Self-citationA semi-direct approach to structure from motion
Jin, H., Favaro, P., & Soatto, S. (2003) · The Visual Computer · doi:10.1007/s00371-003-0202-6 · Cited by 96
Direct Iterative Closest Point for real-time visual odometry
Tykkälä, T., Audras, C., & Comport, A. I. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130500 · Cited by 93
Efficient Homography-Based Tracking and 3-D Reconstruction for Single-Viewpoint Sensors
Christopher Mei, A., Benhimane, S., Malis, E., & Rives, P. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2007941 · Cited by 93
Accurate visual odometry from a rear parking camera
Lovegrove, S. J., Davison, A. J., & Ibañez‐Guzmán, J. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940546 · Cited by 89
Fast Image-Based Tracking by Selective Pixel Integration
Dellaert, F. (2011) · Cited by 81
On the Consistency of Vision-Aided Inertial Navigation
Kottas, D. G., Hesch, J. A., Bowman, S. L., & Roumeliotis, S. I. (2013) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-00065-7_22 · Cited by 76
Direct Sparse OdometryPreprint
Engel, J. J., Koltun, V., & Cremers, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02565 · Cited by 70
On-Manifold Preintegration Theory for Fast and Accurate Visual-Inertial NavigationPreprint
Förster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2015) · arXiv (Cornell University) · Cited by 37
Self-citationReal-time Dense Visual Tracking under Large Lighting Variations
Meilland, M., Comport, A. I., & Rives, P. (2011) · British Machine Vision Conference (BMVC) · doi:10.5244/c.25.45 · Cited by 35
Omnidirectional dense large-scale mapping and navigation based on meaningful triangulation
Pretto, A., Menegatti, E., & Pagello, E. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980206 · Cited by 30
Integration of Euclidean constraints in template based visual tracking of piecewise-planar scenes
Benhimane, S., & Malis, E. (2006) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2006.281859 · Cited by 17
Research works printed but not linked: 8
- chirikjian, 2012, Stochastic Models Information Theory and Lie Groups Volume 2 Analytic Methods and Modern Applications (Applied and Numerical Harmonic Analysis)
- barfoot, 2015, State Estimation for Robotics A Matrix-Lie-Group Approach
- 10.1177/0278364914551008 · DOI
- burri, 2015, The EuRoC MAV datasets, Int J Robot Res
- forster, 2015, Continuous on-board monocular-vision–based aerial elevation mapping for quadrotor landing, Proc IEEE Int Conf Robot Autom, 111
- 10.1109/TRO.2015.2463671 · DOI · Paper page
- kümmerle, 0, g2o: A general framework for graph optimization, Proc IEEE Int Conf Robot Autom, 3607
- 10.5244/C.4.15 · doi:10.5244/c.4.15
Cited by
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Self-citationFAST-LIO2: Fast Direct LiDAR-Inertial Odometry
Xu, W., Cai, Y., He, D., Lin, J., & Zhang, F. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3141876 · Cited by 1,750
Planning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972
Metadata
- Authors
- Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D.
- Venue
- IEEE Transactions on Robotics
- Published
- 2017-04
- Volume
- 33
- Issue
- 2
- Pages
- 249-265
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2564632156
- Cited by
- 922
- References
- 69
- FWCI
- 87.48
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Swiss National Foundation (200021-143607)
- Swarm of Flying Cameras
- National Center of Competence in Research Robotics
- UZH Forschungskredit
- SNSF-ERC Starting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.