The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Structure from motion causally integrated over time
Abstract
We describe an algorithm for reconstructing three-dimensional structure and motion causally, in real time from monocular sequences of images. We prove that the algorithm is minimal and stable, in the sense that the estimation error remains bounded with probability one throughout a sequence of arbitrary length. We discuss a scheme for handling occlusions (point features appearing and disappearing) and drift in the scale factor. These issues are crucial for the algorithm to operate in real time on real scenes. We describe in detail the implementation of the algorithm, which runs on a personal computer and has been made available to the community. We report the performance of our implementation on a few representative long sequences of real and synthetic images. The algorithm, which has been tested extensively over the course of the past few years, exhibits honest performance when the scene contains at least 20-40 points with high contrast, when the relative motion is "slow" compared to the sampling frequency of the frame grabber (30 Hz), and the lens aperture is "large enough" (typically more than 30/spl deg/ of visual field).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1981) · Cited by 11,963
Stochastic Processes and Filtering Theory
(1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6022-4 · Cited by 7,302
Anderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems Man and Cybernetics · Cited by 3,195
Three-dimensional computer vision: a geometric viewpoint
(1994) · Choice Reviews Online · doi:10.5860/choice.32-0357 · Cited by 3,030
Shape and motion from image streams under orthography: a factorization method
Tomasi, C., & Kanade, T. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,878
Stochastic stability of the discrete-time extended Kalman filter
Reif, K., Gunther, S., Yaz, E., & Unbehauen, R. (1999) · IEEE Transactions on Automatic Control · doi:10.1109/9.754809 · Cited by 1,011
Koenderink, J. J., & van Doorn, A. J. (1991) · Journal of the Optical Society of America A · doi:10.1364/josaa.8.000377 · Cited by 871
Adiv, G. (1985) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1985.4767678 · Cited by 800
An Introduction to Stochastic Processes.
Kiefer, J., & Bartlett, M. S. (1956) · The American Mathematical Monthly · doi:10.2307/2306456 · Cited by 749
Kalman filter-based algorithms for estimating depth from image sequences
Matthies, L., Kanade, T., & Szeliski, R. (1989) · International Journal of Computer Vision · doi:10.1007/bf00133032 · Cited by 716
Anderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1982.4308806 · Cited by 485
Recursive estimation of motion, structure, and focal length
Azarbayejani, A., & Pentland, A. P. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.387503 · Cited by 484
Estimation of Object Motion Parameters from Noisy Images
Broida, T. J., & Chellappa, R. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767755 · Cited by 448
Subspace methods for recovering rigid motion I: Algorithm and implementation
Heeger, D. J., & Jepson, A. D. (1992) · International Journal of Computer Vision · doi:10.1007/bf00128130 · Cited by 445
Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares
Szeliski, R., & Kang, S. B. (1994) · Journal of Visual Communication and Image Representation · doi:10.1006/jvci.1994.1002 · Cited by 328
Applications of dynamic monocular machine vision
Dickmanns, E. D., & Graefe, V. (1988) · Machine Vision and Applications · doi:10.1007/bf01212362 · Cited by 277
Optimal motion and structure estimation
Weng, J., Ahuja, N., & Huang, T. S. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.232074 · Cited by 270
Direct recovery of shape from multiple views: a parallax based approach
Kumar, R., Anandan, P., & Hanna, K. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576402 · Cited by 163
Three-dimensional motion computation and object segmentation in a long sequence of stereo frames
Zhang, Z., & Faugeras, O. D. (1992) · International Journal of Computer Vision · doi:10.1007/bf00126394 · Cited by 142
A multi-frame approach to visual motion perception
Spetsakis, M. E., & Aloimonos, J. Y. (1991) · International Journal of Computer Vision · doi:10.1007/bf00115698 · Cited by 140
Optimal Structure from Motion: Local Ambiguities and Global Estimates
Chiuso, A., Brockett, R. W., & Soatto, S. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026563712076 · Cited by 111
Self-citationTracking known three-dimensional objects
Gennery, D. B. (1982) · National Conference on Artificial Intelligence · Cited by 108
A necessary and sufficient condition for the perspective observability problem
Dayawansa, W. P., Ghosh, B. K., Martin, C. F., et al. (1995) · Systems & Control Letters · doi:10.1016/0167-6911(94)00064-3 · Cited by 55
Recursive affine structure and motion from image sequences
McLauchlan, P. F., Reid, I. D., & Murray, D. W. (1994) · Lecture notes in computer science · doi:10.1007/3-540-57956-7_26 · Cited by 52
Jin, H., Favaro, P., & Soatto, S. (2000) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.854954 · Cited by 52
Self-citationEstimation three-dimensional motion of rigid objects from noisy observations
Philip, J. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.67631 · Cited by 49
Tracking facilitates 3-D motion estimation
Fermuller, C. M., & Aloimonos, Y. (1992) · Biological Cybernetics · doi:10.1007/bf00204399 · Cited by 37
A new structure-from-motion ambiguity
Oliensis, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.865186 · Cited by 33
Gauge invariance in projective 3D reconstruction
McLauchlan, P. F. (2003) · doi:10.1109/mview.1999.781081 · Cited by 28
Observability/identifiability of rigid motion under perspective projection
Soatto, S. (2002) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1994.411638 · Cited by 17
Self-citationHeel, J. (1990) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(90)90019-w · Cited by 16
Cited by
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation
Mourikis, A. I., & Roumeliotis, S. I. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364024 · Cited by 1,951
SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems
Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2623335 · Cited by 922
Human activity recognition from 3D data: A review
Aggarwal, J. K., & Xia, L. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.011 · Cited by 576
Large-scale direct SLAM with stereo cameras
Engel, J., Stuckler, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353631 · Cited by 539
Metadata
- Authors
- Chiuso, A., Favaro, P., Jin, H., & Soatto, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2002-04
- Volume
- 24
- Issue
- 4
- Pages
- 523-535
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2139834417
- Cited by
- 324
- References
- 31
- FWCI
- 21.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.