An Introduction to Inertial and Visual Sensing
The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
In this paper we present a tutorial introduction to two important senses for biological and robotic systems — inertial and visual perception. We discuss the fundamentals of these two sensing modalities from a biological and an engineering perspective. Digital camera chips and micro-machined accelerometers and gyroscopes are now commodities, and when combined with today's available computing can provide robust estimates of self-motion as well 3D scene structure, without external infrastructure. We discuss the complementarity of these sensors, describe some fundamental approaches to fusing their outputs and survey the field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
(1981) · Cited by 11,963
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
Stochastic Processes and Filtering Theory
(1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)x6022-4 · Cited by 7,302
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
A new method for the nonlinear transformation of means and covariances in filters and estimators
Julier, S., Uhlmann, J., & Durrant-Whyte, H. F. (2000) · IEEE Transactions on Automatic Control · doi:10.1109/9.847726 · Cited by 3,735
A tutorial on visual servo control
Hutchinson, S., Hager, G. D., & Corke, P. I. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.538972 · Cited by 3,528
Self-citationThree-dimensional computer vision: a geometric viewpoint
(1994) · Choice Reviews Online · doi:10.5860/choice.32-0357 · Cited by 3,030
Multiple View Geometry in Computer Vision (2nd ed)
Hartley, R. I., & Zisserman, A. (2003) · Cambridge University Press eBooks · Cited by 2,761
Micromachined inertial sensors
Yazdi, N., Ayazi, F., & Najafi, K. (1998) · Proceedings of the IEEE · doi:10.1109/5.704269 · Cited by 1,823
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
The New Encyclopaedia Britannica
Goetz, P. W. (1991) · Cited by 1,592
Zhang, Z., Deriche, R., Faugeras, O., & Luong, Q.-T. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(95)00022-4 · Cited by 1,367
Kuipers, J. B. (1999) · Princeton University Press eBooks · doi:10.1515/9780691211701 · Cited by 1,290
Proceedings of the 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems
(2001) · Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems Expanding the Societal Role of Robotics in the the Next Millennium (Cat No 01CH37180) IROS-01 · doi:10.1109/iros.2001.977143 · Cited by 1,197
Carpenter, R. (1977) · Cited by 1,052
Ma, Y., Soatto, S., Košecká, J., & Sastry, S. S. (2004) · Interdisciplinary Applied Mathematics · doi:10.1007/978-0-387-21779-6 · Cited by 893
Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(1997) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609286 · Cited by 853
Visual odometry for ground vehicle applications
Nistér, D., Naroditsky, O., & Bergen, J. (2006) · Journal of Field Robotics · doi:10.1002/rob.20103 · Cited by 634
Inertial sensor technology trends
Barbour, N., & Schmidt, G. (2001) · IEEE Sensors Journal · doi:10.1109/7361.983473 · Cited by 588
Roetenberg, D., Luinge, H. J., Baten, C. T. M., & Veltink, P. H. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.847353 · Cited by 588
Recursive estimation of motion, structure, and focal length
Azarbayejani, A., & Pentland, A. P. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.387503 · Cited by 484
Motion and structure from feature correspondences: a review
Huang, T. S., & Netravali, A. N. (1994) · Proceedings of the IEEE · doi:10.1109/5.265351 · Cited by 468
Proceedings International Conference On Image Processing
(1997) · Proceedings of International Conference on Image Processing · doi:10.1109/icip.1997.638657 · Cited by 337
Recursive 3-D motion estimation from a monocular image sequence
Broida, T. J., Chandrashekhar, S., & Chellappa, R. (1990) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/7.55557 · Cited by 301
Computation of Inertial Motion: Neural Strategies to Resolve Ambiguous Otolith Information
Angelaki, D. E., McHenry, M. Q., Dickman, J. D., Newlands, S. D., & Hess, B. J. M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-01-00316.1999 · Cited by 280
Structure from motion without correspondence
Dellaert, F., Seitz, S. M., Thorpe, C. E., & Thrun, S. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854916 · Cited by 280
Proceedings of International Conference on Robotics and Automation
(1997) · doi:10.1109/robot.1997 · Cited by 267
Perception And Action: Alternative Views
Hurley, S. (2001) · Synthese · doi:10.1023/a:1012643006930 · Cited by 265
Preemptive RANSAC for live structure and motion estimation
Nistér, D. (2005) · Machine Vision and Applications · doi:10.1007/s00138-005-0006-y · Cited by 255
Robotics and autonomous systems
Knasel, T. M. (1988) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(88)90002-4 · Cited by 246
How the eye measures reality and virtual reality
Cutting, J. E. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200563 · Cited by 225
Lawrence, A. (1998) · Mechanical Engineering Series · doi:10.1007/978-1-4612-1734-3 · Cited by 217
Visual and non-visual cues in the perception of linear self motion
Harris, L. R., Jenkin, M., & Zikovitz, D. C. (2000) · Experimental Brain Research · doi:10.1007/s002210000504 · Cited by 212
Modern Inertial Technology: Navigation, Guidance, and Control
Lawrence, A. W. (1993) · Cited by 207
Augmenting inertial navigation with image-based motion estimation
Roumeliotis, S. I., Johnson, A. E., & Montgomery, J. F. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014441 · Cited by 202
Haltere–mediated equilibrium reflexes of the fruit fly, Drosophila melanogaster
Dickinson, M. H. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0442 · Cited by 197
Visually Navigating the RMS Titanic with SLAM Information Filters
Eustice, R., Singh, H., Leonard, J., Walter, M., & Ballard, R. (2005) · Robotics: Science and Systems I · doi:10.15607/rss.2005.i.008 · Cited by 188
X Vision: A Portable Substrate for Real-Time Vision Applications
Hager, G. D., & Toyama, K. (1998) · Computer Vision and Image Understanding · doi:10.1006/cviu.1997.0586 · Cited by 181
Fusion of vision and gyro tracking for robust augmented reality registration
You, S., & Neumann, U. (2002) · Proceedings IEEE Virtual Reality 2001 · doi:10.1109/vr.2001.913772 · Cited by 177
Real-time 3d SLAM with wide-angle vision
Davison, A. J., Cid, Y. G., & Kita, N. (2004) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)32089-x · Cited by 174
Corticovestibular interactions: anatomy, electrophysiology, and functional considerations
Fukushima, K. (1997) · Experimental Brain Research · doi:10.1007/pl00005786 · Cited by 171
(2007) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-540-46402-0 · Cited by 170
2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
(2004) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat No 04CH37566) IROS-04 · doi:10.1109/iros.2004.1389710 · Cited by 165
Real-time implementation of airborne inertial-SLAM
Kim, J., & Sukkarieh, S. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.06.006 · Cited by 161
Motion Estimation from Image and Inertial Measurements
Strelow, D., & Singh, S. (2004) · The International Journal of Robotics Research · doi:10.1177/0278364904045593 · Cited by 158
Hughes, H. C. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/6182.001.0001 · Cited by 148
Vision and inertial sensor cooperation using gravity as a vertical reference
Lobo, J., & Dias, J. M. M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251152 · Cited by 141
Self-citationBuilding a Robust Implementation of Bearing‐only Inertial SLAM for a UAV
Bryson, M., & Sukkarieh, S. (2007) · Journal of Field Robotics · doi:10.1002/rob.20178 · Cited by 138
Orientation tracking for outdoor augmented reality registration
You, S., Neumann, U., & Azuma, R. T. (1999) · IEEE Computer Graphics and Applications · doi:10.1109/38.799738 · Cited by 133
A contribution to vision-based autonomous helicopter flight in urban environments
Muratet, L., Doncieux, S., Brière, Y., & Meyer, J.-A. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.09.017 · Cited by 131
A motion-stabilized outdoor augmented reality system
Azuma, R. T., Hoff, B., Neely, H. E., & Sarfaty, R. (2003) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.1999.756959 · Cited by 125
Proceedings IEEE Virtual Reality 2001
(2001) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2001.913763 · Cited by 112
Computer-vision-based registration techniques for augmented reality
Hoff, W., Nguyen, K., & Lyon, T. (1996) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.256311 · Cited by 102
Epipolar Constraints for Vision-Aided Inertial Navigation
Diel, D. D., DeBitetto, P. A., & Teller, S. J. (2005) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/acvmot.2005.48 · Cited by 101
Lane following combining vision and DGPS
Goldbeck, J., Huertgen, B., Ernst, S., & Kelch, L. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(99)00037-2 · Cited by 91
Gradwell, D., & Rainford, D. (2006) · CRC Press eBooks · doi:10.1201/b13238-71 · Cited by 90
FlightTracker: A Novel Optical/Inertial Tracker for Cockpit Enhanced Vision
Foxlin, E. M., Altshuler, Y., Naimark, L., & Harrington, M. (2005) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2004.32 · Cited by 84
Vehicles capable of dynamic vision: a new breed of technical beings?
Dickmanns, E. D. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00071-x · Cited by 83
Relative position sensing by fusing monocular vision and inertial rate sensors
Rock, S. M., & Huster, A. (2003) · Cited by 80
Augmented virtual environments (AVE): dynamic fusion of imagery and 3D models
Neumann, U., You, S. O., Hu, J., Jiang, B., & Lee, J. (2003) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2003.1191122 · Cited by 78
A Robust Hybrid Tracking System for Outdoor Augmented Reality
Jiang, B., Neumann, U., & You, S. O. (n.d.) · Cited by 75
Chai, L., Hoff, W., & Vincent, T. L. (2002) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474602320935829 · Cited by 73
Vestibular prostheses: The engineering and biomedical issues
Wall, C., Merfeld, D. M., Rauch, S. D., & Black, F. O. (2003) · Journal of Vestibular Research · doi:10.3233/ves-2003-122-305 · Cited by 72
Previc, F. H., Liotti, M., Blakemore, C., Beer, J., & Fox, P. T. (2000) · Experimental Brain Research · doi:10.1007/s002219900298 · Cited by 70
Tightly integrated sensor fusion for robust visual tracking
Klein, G., & Drummond, T. W. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.007 · Cited by 69
Areas of the human brain activated by ambient visual motion, indicating three kinds of self-movement
Beer, J., Blakemore, C. B., Previc, F. H., & Mario Liotti, A. (2002) · Experimental Brain Research · doi:10.1007/s00221-001-0947-y · Cited by 66
Robust Vision for Vision-Based Control of Motion
Vincze, M., & Hager, G. D. (2000) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470546369 · Cited by 61
Visuo-inertial stabilization in space-variant binocular systems
Panerai, F., Giorgio Metta, B., & Sandini, G. (2000) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(99)00072-x · Cited by 55
Camera trajectory estimation using inertial sensor measurements and structure from motion results
Jung, S., & Taylor, C. J. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.991037 · Cited by 49
The effect of gravity on human recognition of disoriented objects
Leone, G. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00040-x · Cited by 46
Visuovestibular perception of self-motion modeled as a dynamic optimization process
Reymond, G., Jacques Droulez, A., & Kemeny, A. A. (2002) · Biological Cybernetics · doi:10.1007/s00422-002-0357-7 · Cited by 45
Learning visual stabilization reflexes in robots with moving eyes
Panerai, F., Giorgio Metta, B., & Sandini, G. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00645-2 · Cited by 39
A Probabilistic Notion of Correspondence and the Epipolar Constraint
Domke, J., & Aloimonos, Y. (2006) · International Symposium on 3D Data Processing, Visualization and Transmission · doi:10.1109/3dpvt.2006.18 · Cited by 25
A Probabilistic Framework for Correspondence and Egomotion
Domke, J., & Aloimonos, Y. (2007) · Springer eBooks · doi:10.1007/978-3-540-70932-9_18 · Cited by 17
Cited by
Sampling-Based Robot Motion Planning: A Review
Elbanhawi, M., & Simic, M. (2014) · IEEE Access · doi:10.1109/access.2014.2302442 · Cited by 786
Wearable soft sensing suit for human gait measurement
Mengüç, Y., Park, Y.-L., Pei, H., Vogt, D., Aubin, P. M., Winchell, E., Fluke, L., Stirling, L., Wood, R. J., & Walsh, C. J. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914543793 · Cited by 415
Stronger, Smarter, Softer: Next-Generation Wearable Robots
Asbeck, A. T., De Rossi, S. M. M., Galiana, I., Ding, Y., & Walsh, C. J. (2014) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2014.2360283 · Cited by 368
Euler–Rodrigues formula variations, quaternion conjugation and intrinsic connections
Dai, J. S. (2015) · Mechanism and Machine Theory · doi:10.1016/j.mechmachtheory.2015.03.004 · Cited by 367
Using Inertial Sensors for Position and Orientation Estimation
Kok, M., Hol, J. D., & Schön, T. B. (2017) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000094 · Cited by 347
Metadata
- Authors
- Corke, P., Lobo, J., & Dias, J.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2007-06
- Volume
- 26
- Issue
- 6
- Pages
- 519-535
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2167640051
- Cited by
- 289
- References
- 79
- FWCI
- 22.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.