The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Kalman Filter for Robot Vision: A Survey
Abstract
Kalman filters have received much attention with the increasing demands for robotic automation. This paper briefly surveys the recent developments for robot vision. Among many factors that affect the performance of a robotic system, Kalman filters have made great contributions to vision perception. Kalman filters solve uncertainties in robot localization, navigation, following, tracking, motion control, estimation and prediction, visual servoing and manipulation, and structure reconstruction from a sequence of images. In the 50th anniversary, we have noticed that more than 20 kinds of Kalman filters have been developed so far. These include extended Kalman filters and unscented Kalman filters. In the last 30 years, about 800 publications have reported the capability of these filters in solving robot vision problems. Such problems encompass a rather wide application area, such as object modeling, robot control, target tracking, surveillance, search, recognition, and assembly, as well as robotic manipulation, localization, mapping, navigation, and exploration. These reports are summarized in this review to enable easy referral to suitable methods for practical solutions. Representative contributions and future research trends are also addressed in an abstract level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Kalman Filter
Welch, G., & Bishop, G. (1995) · CiteSeer X (The Pennsylvania State University) · Cited by 7,039
Guerrero, J. M., Vasquez, J. C., Matas, J., de Vicuna, L. G., & Castilla, M. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2066534 · Cited by 5,075
(2007) · doi:10.1007/978-3-540-38301-7 · Cited by 1,851
State-of-Charge Estimation for Lithium-Ion Batteries Using Neural Networks and EKF
Charkhgard, M., & Farrokhi, M. (2010) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2043035 · Cited by 779
Kalman filter-based algorithms for estimating depth from image sequences
Matthies, L., Kanade, T., & Szeliski, R. (1989) · International Journal of Computer Vision · doi:10.1007/bf00133032 · Cited by 716
Relative end-effector control using Cartesian position based visual servoing
Wilson, W. J., Williams Hulls, C. C., & Bell, G. S. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.538974 · Cited by 623
Papanikolopoulos, N. P., Khosla, P. K., & Kanade, T. (1993) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.210792 · Cited by 568
Vision-Aided Inertial Navigation for Spacecraft Entry, Descent, and Landing
Mourikis, A. I., Trawny, N., Roumeliotis, S. I., Johnson, A. E., Ansar, A., & Matthies, L. (2009) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2012342 · Cited by 345 · cited 7×
“An EKF can tightly integrate multiple types of visual feature observations with measurements from an IMU [4], [15], [102], [142].”
BackgroundMethodInfluentialExactly Sparse Delayed-State Filters for View-Based SLAM
Eustice, R. M., Singh, H., & Leonard, J. J. (2006) · IEEE Transactions on Robotics · doi:10.1109/tro.2006.886264 · Cited by 306
Civera, J., Grasa, O. G., Davison, A. J., & Montiel, J. M. M. (2010) · Journal of Field Robotics · doi:10.1002/rob.20345 · Cited by 261
Road-Boundary Detection and Tracking Using Ladar Sensing
Wijesoma, W. S., Kodagoda, K. R. S., & Balasuriya, A. P. (2004) · IEEE Transactions on Robotics and Automation · doi:10.1109/tra.2004.825269 · Cited by 242
Won, S.-H. P., Melek, W. W., & Golnaraghi, F. (2010) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2009.2032431 · Cited by 204
Underwater SLAM in man‐made structured environments
Ribas, D., Ridao, P., Tardós, J. D., & Neira, J. (2008) · Journal of Field Robotics · doi:10.1002/rob.20249 · Cited by 201
Yi, J., Wang, H., Zhang, J., Song, D., Jayasuriya, S., & Liu, J. (2009) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2026506 · Cited by 197
Efficient View-Based SLAM Using Visual Loop Closures
Mahon, I., Williams, S. B., Pizarro, O., & Johnson-Roberson, M. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004888 · Cited by 184
Vision-Based Localization for Leader–Follower Formation Control
Mariottini, G. L., Morbidi, F., Prattichizzo, D., Vander Valk, N., Michael, N., Pappas, G., & Daniilidis, K. (2009) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2032975 · Cited by 182
People detection and tracking using stereo vision and color
Muñoz-Salinas, R., Aguirre, E., & García-Silvente, M. (2007) · Image and Vision Computing · doi:10.1016/j.imavis.2006.07.012 · Cited by 179
Localization Methods for a Mobile Robot in Urban Environments
Georgiev, A., & Allen, P. K. (2004) · IEEE Transactions on Robotics · doi:10.1109/tro.2004.829506 · Cited by 168
Vision‐aided inertial navigation for pin‐point landing using observations of mapped landmarks
Trawny, N., Mourikis, A. I., Roumeliotis, S. I., Johnson, A. E., & Montgomery, J. F. (2007) · Journal of Field Robotics · doi:10.1002/rob.20189 · Cited by 159
Design of a Fault-Tolerant Controller Based on Observers for a PMSM Drive
Akrad, A., Hilairet, M., & Diallo, D. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2050756 · Cited by 155
Building a Robust Implementation of Bearing‐only Inertial SLAM for a UAV
Bryson, M., & Sukkarieh, S. (2007) · Journal of Field Robotics · doi:10.1002/rob.20178 · Cited by 138
Large-Scale SLAM Building Conditionally Independent Local Maps: Application to Monocular Vision
Piniés, P., & Tardós, J. D. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004636 · Cited by 130
Autonomous Stair Climbing for Tracked Vehicles
Mourikis, A. I., Trawny, N., Roumeliotis, S. I., Helmick, D. M., & Matthies, L. H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907080423 · Cited by 121
Discovering Higher Level Structure in Visual SLAM
Gee, A. P., Chekhlov, D., Calway, A. D., & Mayol-Cuevas, W. W. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004641 · Cited by 121
Salvatore, N., Caponio, A., Neri, F., Stasi, S., & Cascella, G. L. (2009) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2009.2033489 · Cited by 117
A Square Root Unscented Kalman Filter for visual monoSLAM
Holmes, S., Klein, G., & Murray, D. W. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543780 · Cited by 111
An autonomous vision-based mobile robot
Baumgartner, E. T., & Skaar, S. B. (1994) · IEEE Transactions on Automatic Control · doi:10.1109/9.280748 · Cited by 95
Sparse Local Submap Joining Filter for Building Large-Scale Maps
Huang, S., Wang, Z., & Dissanayake, G. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2003259 · Cited by 89
Slip-compensated path following for planetary exploration rovers
Helmick, D. M., Roumeliotis, S. I., Cheng, Y., Clouse, D. S., Bajracharya, M., & Matthies, L. H. (2006) · Advanced Robotics · doi:10.1163/156855306778792470 · Cited by 85
Mobile Robot Localization Using Biased Chirp-Spread-Spectrum Ranging
Cho, H., & Kim, S. W. (2009) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2009.2036633 · Cited by 84
Fusing Monocular Information in Multicamera SLAM
Solà, J., Monin, A., Devy, M., & Vidal‐Calleja, T. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004640 · Cited by 82
Recent advances in simultaneous localization and map-building using computer vision
Chen, Z., Samarabandu, J. K., & Rodrigo, R. P. (2007) · Advanced Robotics · doi:10.1163/156855307780132081 · Cited by 72
Measurement and integration of 3-D structures by tracking edge lines
Crowley, J. L., Stelmaszyk, P., Skordas, T., & Puget, P. (1992) · International Journal of Computer Vision · doi:10.1007/bf00126399 · Cited by 71
Hand–Eye Calibration Applied to Viewpoint Selection for Robotic Vision
Motai, Y., & Kosaka, A. (2008) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2008.921255 · Cited by 69
Estimation of displacements from two 3D frames obtained from stereo
Zhang, Z., & Faugeras, O. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.177380 · Cited by 69
Simultaneous Motion and Structure Estimation by Fusion of Inertial and Vision Data
Gemeiner, P., Einramhof, P., & Vincze, M. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907080058 · Cited by 67
Novel Approach to Position and Orientation Estimation in Vision-Based UAV Navigation
Zhang, J., Wu, Y., Liu, W., & Chen, X. (2010) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2010.5461649 · Cited by 62
Visual SLAM with an Omnidirectional Camera
Rituerto, A., Puig, L., & Guerrero, J. J. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.94 · Cited by 59
Simultaneous localization and mapping: A feature-based probabilistic approach
Skrzypczyński, P. (2009) · International Journal of Applied Mathematics and Computer Science · doi:10.2478/v10006-009-0045-z · Cited by 56
Sliding-Mode Filter Design for Linear Systems With Unmeasured States
Basin, M., & Rodríguez-Ramírez, P. (2010) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2081959 · Cited by 56
Using a LRF sensor in the Kalman-filtering-based localization of a mobile robot
Teslić, L., Škrjanc, I., & Klančar, G. (2009) · ISA Transactions · doi:10.1016/j.isatra.2009.09.009 · Cited by 54
Modeling of Zinc Bromide Energy Storage for Vehicular Applications
Manla, E., Nasiri, A., Rentel, C. H., & Hughes, M. D. (2009) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2009.2030765 · Cited by 49
Pose estimation of Ackerman steering vehicles for outdoors autonomous navigation
Weinstein, A., & Moore, K. L. (2010) · IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2010.5472738 · Cited by 45
Following Controller for Autonomous Mobile Robots Using Behavioral Cues
Chueh, M., Yeung, Y. L. W. A., Lei, K.-P. C., & Joshi, S. S. (2008) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2008.922605 · Cited by 45
A relative map approach to SLAM based on shift and rotation invariants
Martinelli, A., Nguyen, V., Tomatis, N., & Siegwart, R. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.06.009 · Cited by 44
Beating heart motion prediction for robust visual tracking
Richa, R., Bó, A. P. L., & Poignet, P. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509894 · Cited by 43
Neural Network-Aided Extended Kalman Filter for SLAM Problem
Choi, M., Sakthivel, R., & Chung, W. K. (2007) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2007.363565 · Cited by 42
Scaramuzza, D., Siegwart, R., & Martinelli, A. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364908099858 · Cited by 39
Tomographic Imaging of Dynamic Objects With the Ensemble Kalman Filter
Butala, M. D., Frazin, R. A., Chen, Y., & Kamalabadi, F. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2017996 · Cited by 38
Robust 3-D Motion Tracking From Stereo Images: A Model-Less Method
Yu, Y. K., Wong, K. H., Or, S. H., & Chang, M. M. Y. (2008) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2007.911641 · Cited by 37
The Motor Extended Kalman Filter: A Geometric Approach for Rigid Motion Estimation
Bayro-Corrochano, E. J., & Zhang, Y. (2000) · Journal of Mathematical Imaging and Vision · doi:10.1023/a:1011293515286 · Cited by 32
A hybrid estimation approach for autonomous dirt road following using multiple clothoid segments
Manz, M., Hundelshausen, F. V., & Wuensche, H. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509983 · Cited by 32
Color-Based Monocular Visuoinertial 3-D Pose Estimation of a Volant Robot
Kyriakoulis, N., & Gasteratos, A. C. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2010.2045258 · Cited by 31
Southall, B., Hague, T., Marchant, J. A., & Buxton, B. F. (2002) · The International Journal of Robotics Research · doi:10.1177/027836402320556485 · Cited by 30
Simultaneous localization and map building of skid-steered robots
Anousaki, G. C., & Kyriakopoulos, K. (2007) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2007.339625 · Cited by 29
Simultaneous landmark classification, localization and map building for an advanced sonar ring
Fazli, S., & Kleeman, L. (2006) · Robotica · doi:10.1017/s0263574706003079 · Cited by 28
Tsai, C., Dutoit, X., Song, K., BRUSSEL, H. V., & Nuttin, M. (2010) · Asian Journal of Control · doi:10.1002/asjc.204 · Cited by 26
Probabilistic Self-Localization and Mapping - An Asynchronous Multirate Approach
Armesto, L., Ippoliti, G., Longhi, S., & Tornero, J. (2008) · IEEE Robotics & Automation Magazine · doi:10.1109/m-ra.2007.907355 · Cited by 24
Cong, T. H., Kim, Y. J., & Lim, M. (2008) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.1109/iccas.2008.4694596 · Cited by 22
Active Visual Perception for Mobile Robot Localization
Correa, J., & Soto, Á. (2009) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-009-9348-4 · Cited by 21
Stereo Vision Based Self-localization of Autonomous Mobile Robots
Bais, A., Sablatnig, R., Gu, J. J., Khawaja, Y. M., Usman, M., Hasan, G. M., & Iqbal, M. T. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-78157-8_28 · Cited by 15
Square-root unscented Kalman filter based simultaneous localization and mapping
Li, S., & Ni, P. (2010) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2010.5512187 · Cited by 15
Sensor fusion of delay and non-delay signal using Kalman Filter with moving covariance
Pornsarayouth, S., & Wongsaisuwan, M. (2009) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2009.4913316 · Cited by 15
ATTENTIONAL OBJECT DETECTION WITH AN ACTIVE MULTI-FOCAL VISION SYSTEM
Xu, T., Zhang, T., Kühnlenz, K., & BUSS, M. J. (2010) · International Journal of Humanoid Robotics · doi:10.1142/s0219843610002076 · Cited by 14
Landmark detection and localization for mobile robot applications: a multisensor approach
Amarasinghe, D., Mann, G. K. I., & Gosine, R. G. (2009) · Robotica · doi:10.1017/s0263574709990312 · Cited by 14
Implementation of Tracking and Capturing a Moving Object using a Mobile Robot
Kim, S.-J., Park, J.-W., & Lee, J.-M. (2005) · International Journal of Control Automation and Systems · Cited by 13
Control methods for guidance virtual fixtures in compliant human-machine interfaces
Marayong, P., Hager, G. D., & Okamura, A. M. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650838 · Cited by 13
Complementing visual tracking of moving targets by fusion of tactile sensing
Alkkiomäki, O., Kyrki, V., Kalviainen, H. A., Liu, Y., & Handroos, H. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.07.001 · Cited by 12
Gonçalves, J., Lima, J., & Costa, P. (2008) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2008.4676878 · Cited by 12
Binocular Vision-SLAM Using Improved SIFT Algorithm
Zhu, D. (2010) · International Workshop on Intelligent Systems and Applications (ISA) · doi:10.1109/iwisa.2010.5473273 · Cited by 11
CV-SLAM using ceiling boundary
Choi, H., Kim, D. Y., Hwang, J. P., Kim, E., & Kim, Y.-O. (2010) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea.2010.5516788 · Cited by 11
Advanced 3D localization by fusing measurements from GPS, inertial and vision sensors
Ababsa, F. (2009) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2009.5346784 · Cited by 11
Bilateral Symmetry Detection for Real-time Robotics Applications
Li, W. H., Zhang, A. M., & Kleeman, L. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908092131 · Cited by 9
VideoTrek: A vision system for a tag-along robot
Naroditsky, O., Zhu, Z., Das, A., et al. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206696 · Cited by 8
Monocular vision SLAM based on key feature points selection
Wu, E., Zhao, L., Guo, Y., Zhou, W., & Wang, Q. (2010) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2010.5512217 · Cited by 7
EKF-Based Recursive Dual Estimation of Structure and Motion From Stereo Data
Zhang, H., & Negahdaripour, S. (2010) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2010.2041573 · Cited by 7
Sensor fusion-based line detection for unmanned navigation
Chun, C., Suh, S., Roh, C.-W., Kang, Y., Kang, S., Lee, J.-Y., & Han, C.-S. (2010) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5547995 · Cited by 6
Heterogeneous multisensor fusion for mapping dynamic environments
Huang, G. P., Rad, A. B., Wong, Y.-K., & Ip, Y. L. (2007) · Advanced Robotics · doi:10.1163/156855307780108268 · Cited by 6
Autonomous navigation algorithm for precision landing on unknown planetary surfaces
Hyun, B., & Singla, P. (2008) · Cited by 2
Cited by
Visual Tracking: An Experimental Survey
(2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.230 · Cited by 1,513
Industrial Applications of the Kalman Filter: A Review
Auger, F., Hilairet, M., Guerrero, J. M., Monmasson, E., Orlowska-Kowalska, T., & Katsura, S. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2012.2236994 · Cited by 590
Intelligent Particle Filter and Its Application on Fault Detection of Nonlinear System
Yin, S., & zhu, X. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2399396 · Cited by 367
Minimum Error Entropy Kalman Filter
Chen, B., Dang, L., Gu, Y., Zheng, N., & Principe, J. C. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2019.2957269 · Cited by 266
Metadata
- Authors
- Chen, S. Y.
- Venue
- IEEE Transactions on Industrial Electronics
- Published
- 2012-11
- Volume
- 59
- Issue
- 11
- Pages
- 4409-4420
- ISSN
- 0278-0046 (ISSN-L)
- 1557-9948
- OpenAlex
- W2047448918
- Cited by
- 552
- References
- 79
- FWCI
- 25.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.