The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation
Abstract
Vision-aided inertial navigation systems (V-INSs) canprovide precise state estimates for the 3-D motion of a vehicle when no external references (e.g., GPS) are available. This is achieved bycombining inertial measurements from an inertial measurement unit (IMU) with visual observations from a camera under the assumption that the rigid transformation between the two sensors is known. Errors in the IMU-camera extrinsic calibration process cause biases that reduce the estimation accuracy and can even lead to divergence of any estimator processing the measurements from both sensors. In this paper, we present an extended Kalman filter for precisely determining the unknown transformation between a camera and an IMU. Contrary to previous approaches, we explicitly account for the time correlation of the IMU measurements and provide a figure of merit (covariance) for the estimated transformation. The proposed method does not require any special hardware (such as spin table or 3-D laser scanner) except a calibration target. Furthermore, we employ the observability rank criterion based on Lie derivatives and prove that the nonlinear system describing the IMU-camera calibration process is observable. Simulation and experimental results are presented that validate the proposed method and quantify its accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Fundamentals of Statistical Signal Processing: Estimation Theory
Sengijpta, S. K. (1995) · Technometrics · doi:10.1080/00401706.1995.10484391 · Cited by 11,076
Fundamentals of statistical signal processing: Estimation theory
Prasad, K. V. (1994) · Control Engineering Practice · doi:10.1016/0967-0661(94)90195-3 · Cited by 7,902
Stochastic Processes and Filtering Theory
(1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6022-4 · Cited by 7,302
Closed-form solution of absolute orientation using unit quaternions
Horn, B. K. P. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000629 · Cited by 4,116
Strapdown Inertial Navigation Technology
Titterton, D., & Weston, J. (2004) · Institution of Engineering and Technology eBooks · doi:10.1049/pbra017e · Cited by 3,348
Nonlinear Dynamical Control Systems
Nijmeijer, H., & van der Schaft, A. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2101-0 · Cited by 3,265
Stochastic models, estimation, and control
(1982) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6186-7 · Cited by 3,229
Nonlinear controllability and observability
Hermann, R., & Krener, A. (1977) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1977.1101601 · Cited by 2,374 · cited 4×
“Finally, a comprehensive observability analysis based on Lie derivatives [ 17 ], [18] is performed to ensure that the sensor measurements provide sufficient information for accurately estimating the IMU-camera transformation.”
BackgroundMethodInfluentialVidyasagar, M., & Desoer, C. A. (1980) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1980.4308549 · Cited by 2,011
Sastry, S. (1999) · Interdisciplinary Applied Mathematics · doi:10.1007/978-1-4757-3108-8 · Cited by 1,764
Stochastic models, estimation, and control
(1979) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6125-9 · Cited by 1,624
Direct Methods for Sparse Linear Systems
Davis, T. A. (2006) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718881 · Cited by 1,443
A new technique for fully autonomous and efficient 3D robotics hand/eye calibration
Tsai, R. Y., & Lenz, R. K. (1989) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.34770 · Cited by 1,398
Rugh, W. J. (1992) · Cited by 1,395
Kalman Filtering for Spacecraft Attitude Estimation
Lefferts, E. J., Markley, F. L., & Shuster, M. D. (1982) · Journal of Guidance, Control, and Dynamics · doi:10.2514/3.56190 · Cited by 1,344
Brogan, W. L. (1971) · International Linear Collider · Cited by 1,203
The Institute of Electrical and Electronics Engineers
(1963) · Nature · doi:10.1038/200118c0 · Cited by 790
Hand-Eye Calibration Using Dual Quaternions
Daniilidis, K. (1999) · The International Journal of Robotics Research · doi:10.1177/02783649922066213 · Cited by 729
Pose estimation from corresponding point data
Haralick, R. M., Joo, H., Lee, C., Zhuang, X., Vaidya, V. G., & Kim, M. B. (1989) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.44063 · Cited by 627
Recursive estimation of motion, structure, and focal length
Azarbayejani, A., & Pentland, A. P. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.387503 · Cited by 484
(2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7 · Cited by 471
Linear pose estimation from points or lines
Ansar, A., & Daniilidis, K. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195992 · Cited by 434
Fundamentals Of High Accuracy Inertial Navigation
Chatfield, A. B. (1997) · American Institute of Aeronautics and Astronautics eBooks · doi:10.2514/4.866463 · Cited by 427
Vision-Aided Inertial Navigation for Spacecraft Entry, Descent, and Landing
Mourikis, A. I., Trawny, N., Roumeliotis, S. I., Johnson, A. E., Ansar, A., & Matthies, L. (2009) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2012342 · Cited by 345 · cited 1×
“Furthermore, by tracking visual features through sequences of images, the motion of the camera can be estimated [5], [6].”
Self-citationFinding the Position and Orientation of a Sensor on a Robot Manipulator Using Quaternions
Chou, J. C. K., & Kamel, M. (1991) · The International Journal of Robotics Research · doi:10.1177/027836499101000305 · Cited by 263
Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain
Johnson, A., Montgomery, J., & Matthies, L. H. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2005.1570727 · Cited by 131
Observability analysis for mobile robot localization
Martinelli, A., & Siegwart, R. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545153 · Cited by 128
Kalman filtering for spacecraft attitude estimation
Lefferts, E. J., Markley, F. L., & Shuster, M. D. (1982) · 20th Aerospace Sciences Meeting · doi:10.2514/6.1982-70 · Cited by 121
On the Observability and Observability Analysis of SLAM
Lee, K., Wijesoma, W. S., & Guzman, J. I. (2006) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2006.281646 · Cited by 113
Vision-based Localization of Leader-Follower Formations
Mariottini, G. L., Pappas, G. J., Prattichizzo, D., et al. (2006) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc.2005.1582227 · Cited by 94
Generalized architecture for simultaneous localization, auto-calibration, and map-building
Foxlin, E. M. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041444 · Cited by 60
A dual-layer estimator architecture for long-term localization
Mourikis, A. I., & Roumeliotis, S. I. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563131 · Cited by 59
Self-citationBonnifait, P., & Garcia, G. (1998) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.704218 · Cited by 57
Sun, D., & Crassidis, J. L. (2002) · Journal of Guidance Control and Dynamics · doi:10.2514/2.4995 · Cited by 54
The effects of partial observability when building fully correlated maps
Andrade‐Cetto, J., & Sanfeliu, A. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2004.842342 · Cited by 53
Field Testing of the Mars Exploration Rovers Descent Image Motion Estimation System
Johnson, A., Willson, R. G., Goguen, J. D., Alexander, J. W., & Meller, D. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2005.1570807 · Cited by 38
Automatic self-calibration of a vision system during robot motion
Martinelli, A., Scaramuzza, D., & Siegwart, R. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2006.1641159 · Cited by 38
IMU-Camera Calibration: Observability Analysis
Mirzaei, F. M., & Roumeliotis, S. I. (2007) · Cited by 4
Self-citation
Cited by
Keyframe-based visual–inertial odometry using nonlinear optimization
Leutenegger, S., Lynen, S., Bosse, M., Siegwart, R., & Furgale, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554813 · Cited by 1,723
A compilation of UAV applications for precision agriculture
Radoglou-Grammatikis, P., Sarigiannidis, P., Lagkas, T., & Moscholios, I. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107148 · Cited by 957
High-precision, consistent EKF-based visual-inertial odometry
Li, M., & Mourikis, A. I. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913481251 · Cited by 813
Unified temporal and spatial calibration for multi-sensor systems
Furgale, P., Rehder, J., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696514 · Cited by 807
A robust and modular multi-sensor fusion approach applied to MAV navigation
Lynen, S., Achtelik, M. W., Weiss, S., Chli, M., & Siegwart, R. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696917 · Cited by 572
Metadata
- Authors
- Mirzaei, F. M., & Roumeliotis, S. I.
- Venue
- IEEE Transactions on Robotics
- Published
- 2008-10
- Volume
- 24
- Issue
- 5
- Pages
- 1143-1156
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2140924050
- Cited by
- 442
- References
- 39
- FWCI
- 29.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.