The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Structure from motion causally integrated over time
Abstract
We describe an algorithm for reconstructing three-dimensional structure and motion causally, in real time from monocular sequences of images. We prove that the algorithm is minimal and stable, in the sense that the estimation error remains bounded with probability one throughout a sequence of arbitrary length. We discuss a scheme for handling occlusions (point features appearing and disappearing) and drift in the scale factor. These issues are crucial for the algorithm to operate in real time on real scenes. We describe in detail the implementation of the algorithm, which runs on a personal computer and has been made available to the community. We report the performance of our implementation on a few representative long sequences of real and synthetic images. The algorithm, which has been tested extensively over the course of the past few years, exhibits honest performance when the scene contains at least 20-40 points with high contrast, when the relative motion is "slow" compared to the sampling frequency of the frame grabber (30 Hz), and the lens aperture is "large enough" (typically more than 30/spl deg/ of visual field).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1981) · Cited by 11,963
Stochastic Processes and Filtering Theory
(1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6022-4 · Cited by 7,302
Anderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems Man and Cybernetics · Cited by 3,195
Three-dimensional computer vision: a geometric viewpoint
(1994) · Choice Reviews Online · doi:10.5860/choice.32-0357 · Cited by 3,030
Shape and motion from image streams under orthography: a factorization method
Tomasi, C., & Kanade, T. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,878
Stochastic stability of the discrete-time extended Kalman filter
Reif, K., Gunther, S., Yaz, E., & Unbehauen, R. (1999) · IEEE Transactions on Automatic Control · doi:10.1109/9.754809 · Cited by 1,011
Koenderink, J. J., & van Doorn, A. J. (1991) · Journal of the Optical Society of America A · doi:10.1364/josaa.8.000377 · Cited by 871
Adiv, G. (1985) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1985.4767678 · Cited by 800
An Introduction to Stochastic Processes.
Kiefer, J., & Bartlett, M. S. (1956) · The American Mathematical Monthly · doi:10.2307/2306456 · Cited by 749
Kalman filter-based algorithms for estimating depth from image sequences
Matthies, L., Kanade, T., & Szeliski, R. (1989) · International Journal of Computer Vision · doi:10.1007/bf00133032 · Cited by 716
Cited by
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
Human activity recognition from 3D data: A review
Aggarwal, J. K., & Xia, L. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.011 · Cited by 576
Large-scale direct SLAM with stereo cameras
Engel, J., Stuckler, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353631 · Cited by 539
Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration
Kelly, J., & Sukhatme, G. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910382802 · Cited by 536
Monocular Model-Based 3D Tracking of Rigid Objects: A Survey
Lepetit, V., & Fua, P. (2005) · now publishers, Inc. eBooks · doi:10.1561/9781933019536 · Cited by 526
Monocular model-based 3D tracking of rigid objects: a survey
Lepetit, V., & Fua, P. (2005) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000001 · Cited by 484
Strasdat, H., Montiel, J. M. M., & Davison, A. J. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.02.009 · Cited by 439
Visual-inertial navigation, mapping and localization: A scalable real-time causal approach
Jones, E. S., & Soatto, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910388963 · Cited by 435
Self-citationStereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schworer, M., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 401
Eade, E., & Drummond, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.263 · Cited by 396
Consistency Analysis and Improvement of Vision-aided Inertial Navigation
Hesch, J. A., Kottas, D. G., Bowman, S. L., & Roumeliotis, S. I. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2277549 · Cited by 266
RGB-D SLAM in Dynamic Environments Using Point Correlations
Dai, W., Zhang, Y., Li, P., Fang, Z., & Scherer, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3010942 · Cited by 265
Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles
Kendoul, F., Fantoni, I., & Nonami, K. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.02.001 · Cited by 256
Camera-IMU-based localization: Observability analysis and consistency improvement
Hesch, J. A., Kottas, D. G., Bowman, S. L., & Roumeliotis, S. I. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364913509675 · Cited by 245
“Jones and Soatto (2011) investigated VINS observability by examining the indistinguishable trajectories of the system (Isidori 1989) under different sensor configurations (i.e. inertial only, vision only, vision and inertial).”
BackgroundInfluentialLarge-scale direct SLAM for omnidirectional cameras
Caruso, D., Engel, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353366 · Cited by 244
Metadata
- Authors
- Chiuso, A., Favaro, P., Jin, H., & Soatto, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2002-04
- Volume
- 24
- Issue
- 4
- Pages
- 523-535
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2139834417
- Cited by
- 324
- References
- 31
- FWCI
- 21.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.