Double window optimisation for constant time visual SLAM
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
We present a novel and general optimisation framework for visual SLAM, which scales for both local, highly accurate reconstruction and large-scale motion with long loop closures. We take a two-level approach that combines accurate pose-point constraints in the primary region of interest with a stabilising periphery of pose-pose soft constraints. Our algorithm automatically builds a suitable connected graph of keyposes and constraints, dynamically selects inner and outer window membership and optimises both simultaneously. We demonstrate in extensive simulation experiments that our method approaches the accuracy of offline bundle adjustment while maintaining constant-time operation, even in the hard case of very loopy monocular camera motion. Furthermore, we present a set of real experiments for various types of visual sensor and motion, including large scale SLAM with both monocular and stereo cameras, loopy local browsing with either monocular or RGB-D cameras, and dense RGB-D object model building.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“inspired by [223], Strasdat et al. [235] take a two-stage approach and optimize first a local pose-features graph and then a pose-pose graph; Williams et al. [259] split factor graph optimization in a high-frequency filter and lowfrequency smoother, which are periodically synchronized.”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [235]
Citations
Cites
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346 · cited 3×
“For example, PTAM [6] runs full bundle adjustment in a background thread, which limits its scale to small workspaces.”
BackgroundClosed-form solution of absolute orientation using unit quaternions
Horn, B. K. P. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000629 · Cited by 4,116 · cited 2×
“Given a set of three 3D-3D corresponences, a relative pose Ti,ref is uniquely defined [3].”
BRIEF: Binary Robust Independent Elementary Features
Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_56 · Cited by 3,597 · cited 1×
“Afterwards, we use guided BRIEF [1] matching between measurements and candidate points seeded at FAST [15] corners – followed by 3D to 3D robust pose refinement to produce an initial pose estimate.”
MethodScalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579 · cited 1×
“Candidates for large loop closures can be efficiently detected using appearance information only [2, 14].”
BackgroundPhoto tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
G2o: A general framework for graph optimization
Kummerle, R., Grisetti, G., Strasdat, H., Konolige, K., & Burgard, W. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5979949 · Cited by 1,982 · cited 2×
“Both methods are implemented using the efficient state-of-the-art sparse graph optimizer g(2)o [9] and executed on a single core of an Intel(R) Core(TM) i7 960 desktop computer.”
MethodSelf-citationPhoto tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141964 · Cited by 696
FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping
Konolige, K., & Agrawal, M. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004832 · Cited by 532 · cited 3×
“Instead of estimating this uncertainty accurately using proper marginalisation [8], we suggest to approximate ΛTji coarsely:”
BackgroundMethodSelf-citationReal Time Localization and 3D Reconstruction
Mouragnon, E., Lhuillier, M., Dhome, M., Dekeyser, F., & Sayd, P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) · doi:10.1109/cvpr.2006.236 · Cited by 396 · cited 1×
“In general, keyframes are fixed at the boundary of the active window, and all those keyframes with co-visible points are typically included [13].”
Background
Research works printed but not linked: 1
- rosten, 2006, Machine learning for highspeed corner detection, Proceedings of the European Conference on Computer Vision (ECCV)
Cited by
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
“[8] performs a joint optimization of BA (point-pose constraints) in an inner window of keyframes and pose graph (pose-pose constraints) in an outer window.”
BackgroundMethodInfluentialORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
“[6], [7], the optimization framework g2o by Kuemmerle et al.”
BackgroundMethodInfluentialSelf-citationORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM
Campos, C., Elvira, R., Rodriguez, J. J. G., M. Montiel, J. M., & D. Tardos, J. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075644 · Cited by 4,274
Self-citationPast, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“[235] take a two-stage approach and optimize first a local pose-features graph and then a pose-pose graph; Williams et al.”
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Self-citationPast, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
“’s work on double window optimisation [20].”
Self-citationElasticFusion: Real-time dense SLAM and light source estimation
Whelan, T., Salas-Moreno, R. F., Glocker, B., Davison, A. J., & Leutenegger, S. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364916669237 · Cited by 698
“To evaluate the trajectory estimation performance of our approach we test our system on the RGB-D benchmark of Sturm et al. (2012). This benchmark provides synchronized ground truth poses for an RGB-D sensor moved through a scene, captured with a highly precise motion capture system.”
BackgroundMethodSelf-citationPL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments
Gomez-Ojeda, R., Moreno, F.-A., Zuniga-Noel, D., Scaramuzza, D., & Gonzalez-Jimenez, J. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2899783 · Cited by 560
Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schworer, M., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 401
“proposed to expand the concept of keyframes to integrate scale [26] and proposed a double window optimization [25].”
BackgroundLDSO: Direct Sparse Odometry with Loop Closure
Gao, X., Wang, R., Demmel, N., & Cremers, D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593376 · Cited by 327
Multiple-Robot Simultaneous Localization and Mapping: A Review
Saeedi, S., Trentini, M., Seto, M., & Li, H. (2016) · Journal of Field Robotics · doi:10.1002/rob.21620 · Cited by 324
“, 2011), ScaViSLAM (Strasdat et al., 2011), fast odometry (Dryanovski et al.”
BackgroundA Comparative Analysis of LiDAR SLAM-Based Indoor Navigation for Autonomous Vehicles
Zou, Q., Sun, Q., Chen, L., Nie, B., & Li, Q. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3063477 · Cited by 321
A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM
Nikolic, J., Rehder, J., Burri, M., Gohl, P., Leutenegger, S., Furgale, P. T., & Siegwart, R. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906892 · Cited by 270
“A vast amount of data from low-cost, lightweight cameras enables incredibly powerful SLAM or structure-from-motion (SfM) systems that perform accurate, large-scale localization and (dense) mapping in real-time [2], [3].”
BackgroundFast relocalisation and loop closing in keyframe-based SLAM
Mur-Artal, R., & Tardos, J. D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906953 · Cited by 264
“Here we extend that work using ORB [9], rotation invariant, scale aware features.”
MethodLarge-scale direct SLAM for omnidirectional cameras
Caruso, D., Engel, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353366 · Cited by 244
“This can be done in a filtering framework [3], [4], [5], or in a keyframe-based non-linear optimization framework [6], [7], [8].”
Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation
Yang, X., Li, H., Zhai, H., Ming, Y., Liu, Y., & Zhang, G. (2022) · 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar55827.2022.00066 · Cited by 234
“These keyframes, including the recently tracked frame, can be seen as an optimization window akin to the sliding window approach employed in traditional SLAM systems [27].”
MethodMonocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium
Weiss, S., Achtelik, M. W., Lynen, S., Achtelik, M. C., Kneip, L., Chli, M., & Siegwart, R. (2013) · Journal of Field Robotics · doi:10.1002/rob.21466 · Cited by 237
“More recent work like that of Strasdat et al. (2011) presents a solu-tion of constant complexity while still keeping the benefits of SLAM (i.e., loop closure).”
BackgroundComputer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · doi:10.1561/9781680836899 · Cited by 232
S-PTAM: Stereo Parallel Tracking and Mapping
Pire, T., Fischer, T., Castro, G., De Cristóforis, P., Civera, J., & Jacobo Berlles, J. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.03.019 · Cited by 192
“Among others the system uses [38] for loop closure detection, [39] to update the pose graph accounting for the monocular scale drift, and the covisibility map technique proposed in [36] for large trajectories.”
BackgroundMethodBuilding a 3-D Line-Based Map Using Stereo SLAM
Zhang, G., Lee, J. H., Lim, J., & Suh, I. H. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2489498 · Cited by 188
“We can see one example in [9], which proposes locally metric and globally topological methods, or, as with [10], by a double-window method to process the bundle adjustment and pose optimization in parallel.”
MethodGeorgiou, T., Liu, Y., Chen, W., & Lew, M. (2020) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-019-00183-w · Cited by 187
“Some representative work can be found in [59,60,132,187,263,308].”
BackgroundThe Design and Implementation of a Mobile RFID Tag Sorting Robot
Shangguan, L., & Jamieson, K. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906417 · Cited by 186
“Simultaneous Localization and Mapping (SLAM) jointly localizes a robot in an unknown environment, building a consistent map of the environment using sensors such as lidar and cameras [10, 14, 29].”
BackgroundCloud Robotics: Current Status and Open Issues
Wan, J., Tang, S., Yan, H., Li, D., Wang, S., & Vasilakos, A. V. (2016) · IEEE Access · doi:10.1109/access.2016.2574979 · Cited by 176
“[38] proposed Scalable Visual SLAM (ScaViSLAM) aimed at handling large scale environment exploring.”
BackgroundTsintotas, K. A., Bampis, L., & Gasteratos, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3175656 · Cited by 175
Keyframe-based monocular SLAM: design, survey, and future directions
Younes, G., Asmar, D., Shammas, E., & Zelek, J. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.09.010 · Cited by 191
“optimization); To reduce the computational expenses of bundle adjustment, Strasdat et al. (2011) proposed to represent the monocular SLAM map by both a Euclidean map for LBA, and a topological map for pose graph optimization that explicitly distributes the accumulated drift along the entire map.”
BackgroundMethodInfluentialVisual and Visual‐Inertial SLAM: State of the Art, Classification, and Experimental Benchmarking
Servières, M., Renaudin, V., Dupuis, A., & Antigny, N. (2021) · Journal of Sensors · doi:10.1155/2021/2054828 · Cited by 181
“Two interesting PTAM-derived algorithms are the stereo version of PTAM [78] and the Double-Windowed Optimization (DWO) [79] framework.”
Zubizarreta, J., Aguinaga, I., & Montiel, J. M. M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2991614 · Cited by 164
“Later, [6] proposes a double window optimization to extend the potential of feature-based VSLAM to long-term applications.”
BackgroundSelf-citationVDO-SLAM: A Visual Dynamic Object-aware SLAM SystemPreprint
Zhang, J., Henein, M., Mahony, R. E., & Ila, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11052 · Cited by 235
Stereo parallel tracking and mapping for robot localization
Pire, T., Fischer, T., Civera, J., Cristoforis, P. D., & Berlles, J. J. (2015) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.1109/iros.2015.7353546 · Cited by 120
“Large-scale environments are tackled in more recent approaches [12], [13] by proposing strategies based on variations of the relative Bundle Adjustment [14] method, which allows for constant-time estimation in terms of map size.”
MethodProbabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM
Mur-Artal, R., & Tardós, J. D. (2015) · Robotics: Science and Systems · doi:10.15607/rss.2015.xi.041 · Cited by 130
“Building on excellent feature-based algorithms developed in the last years [8, 18, 19, 16, 9, 5], we have designed ORBSLAM, a new feature-based monocular SLAM system [12], whose source code is online available1.”
MethodORBSLAM-Based Endoscope Tracking and 3D Reconstruction
Mahmoud, N., Cirauqui, I., Hostettler, A., Doignon, C., Soler, L., Marescaux, J., & Montiel, J. M. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54057-3_7 · Cited by 139
Self-citationDirect Visual SLAM Using Sparse Depth for Camera-LiDAR System
Shin, Y.-S., Park, Y. S., & Kim, A. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461102 · Cited by 115
Linegar, C., Churchill, W., & Newman, P. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7138985 · Cited by 110
“We distinguish between local and large-scale localisation [14], where large-scale loop closures are detected using FAB-MAP [15], and local localisation (the focus of this paper) is performed within a local metric neighbourhood of the robot’s position estimate in the experience graph.”
BackgroundMethodDynamic SLAM: The Need For Speed
Henein, M., Zhang, J., Mahony, R. E., & Ila, V. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196895 · Cited by 131
“In long-term applications, different techniques can be applied to limit the growth of the graph [40], [41].”
BackgroundLovegrove, S., Patron-Perez, A., & Sibley, G. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.93 · Cited by 106
“A number of real-time visual odometry and SLAM systems have been proposed previously, including those that operate on stereo sequences, such as [6, 20, 29], and monocular”
BackgroundZubizarreta, J., Aguinaga, I., & Martinez Montiel, J. M. (2021) · Zaguan (Universidad de Zaragoza) · Cited by 105
A Spline-Based Trajectory Representation for Sensor Fusion and Rolling Shutter Cameras
Patron-Perez, A., Lovegrove, S., & Sibley, G. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0811-3 · Cited by 104
“A number of real-time visual odometry and SLAM systems have been proposed previously, including those that operate on stereo (Comport et al. 2007; Mei et al. 2010; Strasdat et al. 2011) and monocular sequences (Davison 2003; Klein and Murray 2008; Strasdat et al.”
BackgroundDVL-SLAM: sparse depth enhanced direct visual-LiDAR SLAM
Shin, Y.-S., Park, Y. S., & Kim, A. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09881-0 · Cited by 120
“…in visual SLAM, most of which concentrate on using corner-like visual features such as Scale Invariant Feature Transform (SIFT), Speeded Up Ro-bust Features (SURF) and Oriented FAST and Rotated BRIEF (ORB) (Klein and Murray, 2007; Kitt et al., 2010; Strasdat et al., 2011; Mur-Artal et al., 2015).”
BackgroundCollaborative visual SLAM for multiple agents:A brief survey
Zou, D., Tan, P., & Yu, W. (2019) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2019.09.002 · Cited by 99
Multi-camera visual SLAM for autonomous navigation of micro aerial vehicles
Yang, S., Scherer, S., Yi, X., & Zell, A. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.03.018 · Cited by 101
“Although we have seen successful applications of visual SLAM on ground vehicles (Cummins and Newman, 2008; Strasdat et al., 2011), there are more challenges in using visual SLAM to enable autonomous navigation of MAVs.”
MethodSimultaneous Localization and Mapping in the Epoch of Semantics: A Survey
Sualeh, M., & Kim, G.-W. (2018) · International Journal of Control Automation and Systems · doi:10.1007/s12555-018-0130-x · Cited by 94
“RSLAM [125] 11 St F SIFT BA GN - - + + + ScaViSLAM [126] 11 St|R F SURF BA G2O - + + + + -”
Real-Time Monocular Visual Odometry for Turbid and Dynamic Underwater Environments
Ferrera, M., Moras, J., Trouvé-Peloux, P., & Creuze, V. (2019) · Sensors · doi:10.3390/s19030687 · Cited by 100
“e most recent ones in order to optimize the estimated trajectory along with the structure of the 3D map through bundle adjustment. In this, the method follows the approach of Klein and Murray (2007), Strasdat et al. (2011) and Mur-Artal et al. (2015). However, in opposition to these methods we do not build the trackin…”
MethodAir-ground localization and map augmentation using monocular dense reconstruction
Förster, C., Pizzoli, M., & Scaramuzza, D. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696924 · Cited by 84
Map2DFusion: Real-time incremental UAV image mosaicing based on monocular SLAM
Bu, S., Zhao, Y., Wan, G., & Liu, Z. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759672 · Cited by 107
“Since direct bundle adjust approach takes too much time to do optimization, a pose graph optimization described in [34] is utilized to decrease the drifts of key-frames and refine corresponding map-points.”
MethodMulti-Camera Tracking and Mapping for Unmanned Aerial Vehicles in Unstructured Environments
Harmat, A., Trentini, M., & Sharf, I. (2014) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-014-0085-y · Cited by 86
“Large maps can be better handled by optimizing the incremental map updates, as is done with the SAM approach of [9], by splitting the map into hierarchies [17], or applying a double window approach similar to our current method, but with “soft” boundary constraints that help with convergence [41].”
MethodLin, B., Sun, Y., Qian, X., Goldgof, D. B., Gitlin, R. D., & You, Y. (2015) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1661 · Cited by 87
“In robotics, the early work of SLAM with stereo cameras on a mobile robot can be found in (131 – 133) and the more recent work is focused on how to apply stereo cameras in a large environment (134 – 138).”
BackgroundSimultaneous Localization And Mapping: Present, Future, and the Robust-Perception Age.Preprint
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · arXiv (Cornell University) · Cited by 90
Pose Graph optimization for Unsupervised Monocular Visual Odometry
Li, Y., Ushiku, Y., & Harada, T. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793706 · Cited by 71
“word based place recognition tool: DBoW2 [15], and the insight of using Covisibility / Essential Graph optimization [7][8][16][17] for large-scale loop closing operation, to design a hybrid VO system with the following contributions:”
MethodSelf-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle
Heng, L., Lee, G. H., & Pollefeys, M. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9466-8 · Cited by 79
“For graph optimization, we use the double-window optimization method [3] which we implement using Google’s Ceres Solver [1].”
MethodInfluentialDirect Sparse OdometryPreprint
Engel, J. J., Koltun, V., & Cremers, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02565 · Cited by 70
“be integrated with other optimization frameworks like (double-windowed) bundle adjustment [25] or incremental smoothing and mapping [14].”
MethodCOP-SLAM: Closed-Form Online Pose-Chain Optimization for Visual SLAM
Dubbelman, G., & Brett Browning, A. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2473455 · Cited by 67
“[20] that, similar to COP-SLAM, is aimed at large-scale 3D visual-SLAM tasks.”
BackgroundMethodInfluentialLoosely-Coupled Semi-Direct Monocular SLAM
Lee, S. H., & Civera, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2889156 · Cited by 81
“Based on multiple successful ideas of PTAM and others [12]–[14], ORB-SLAM uses ORB features [8] to perform”
MethodReal-time 6-DOF monocular visual SLAM in a large-scale environment
Lim, H., Lim, J., & Kim, H. J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907055 · Cited by 61
“[12] proposed double-window optimization framework.”
Loosely-Coupled Semi-Direct Monocular SLAM
Lee, S. H., & Civera, J. (2019) · Zaguan (University of Zaragoza Repository) · Cited by 63
Recovering Stable Scale in Monocular SLAM Using Object-Supplemented Bundle Adjustment
Frost, D., Prisacariu, V. A., & Murray, D. W. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2820722 · Cited by 70
“Strasdat et al. [48] have shown that a global bundle adjustment is unnecessary as accurate structure is only required around the current camera estimate.”
BackgroundLarge-scale and drift-free surface reconstruction using online subvolume registration
Fioraio, N., Taylor, J., Fitzgibbon, A. W., Stefano, L. D., & Izadi, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299077 · Cited by 69
“Others systems more explicitly detect loop closures and distribute the accumulated error across the underlying pose graph [18, 7].”
BackgroundVectorization for digital signal processors via equality saturation
VanHattum, A., Nigam, R., Lee, V. T., Bornholt, J., & Sampson, A. (2021) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3445814.3446707 · Cited by 87
“Other applications, such as simultaneous localization and mapping (SLAM) [20, 21, 33, 34] and structure from motion [35], have many components that are dominated entirely by small-scale kernels.”
BackgroundObject-aware bundle adjustment for correcting monocular scale drift
Frost, D., Kähler, O., & Murray, D. W. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487680 · Cited by 67
“We propose combining the local bundle adjustment with a pose-graph optimisation as described in Strasdat et al. ’s double window method [44].”
MethodSurvey of Landmark-based Indoor Positioning Technologies
Jang, B., Kim, H., & Kim, J. W. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.08.013 · Cited by 61
C-KLAM: Constrained keyframe-based localization and mapping
Nerurkar, E. D., Wu, K. J., & Roumeliotis, S. I. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907385 · Cited by 65
“Keyframe-based pose-graph approaches [11], [12], [13], [14], [15], [16], on the other hand, make use of all information from both key and non-key frames, but measurements from each frame are used multiple times to generate relative pose-to-pose constraints, especially in loop closure events.”
BackgroundFast ORB-SLAM Without Keypoint Descriptors
Fu, Q., Yu, H., Wang, X., Yang, Z., He, Y., Zhang, H., & Mian, A. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3136710 · Cited by 64
“It is developed based on many excellent works, e.g., the first real-time visual SLAM system, PTAM [21], a fast place recognition method, BoW2 [22], and an efficient graph-based bundle adjustment (BA) algorithm, covisibility graph [23].”
BackgroundMethodA comparison of feature descriptors for visual SLAM
Hartmann, J., Klüssendorff, J. H., & Maehle, E. (2013) · European Conference on Mobile Robots · doi:10.1109/ecmr.2013.6698820 · Cited by 59
“Accurate and efficient solutions have for example been introduced in [2], [3]”
BackgroundJoint Detection, Tracking and Mapping by Semantic Bundle Adjustment
Fioraio, N., & Stefano, L. D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.202 · Cited by 58
“The system builds on established tracking and mapping techniques to exploit incremental 3D reconstruction in order to validate hypotheses on the presence and pose of sought objects.”
MethodDense Visual SLAM with Probabilistic Surfel Map
Yan, Z., Ye, M., & Ren, L. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2734458 · Cited by 58
“In sparse visual SLAM approaches, the criteria can be based on visual information such as the number of co-visible features in current frame (e.g., [20] and [27]).”
BackgroundCluster-based loop closing detection for underwater slam in feature-poor regions
Negre, P. L., Font, F. B., & Oliver, G. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487416 · Cited by 57
“In the classical visual SLAM systems, the loop closing detection is performed between two keyframes [19], [15].”
BackgroundZhang, Z., Zhao, R., Liu, E., Yan, K., & Ma, Y. (2018) · Sensors · doi:10.3390/s18061948 · Cited by 53
“[8] construct d a m nolithic iterative nonlinear optimizer that i cludes two parts of both bundle-adjustment to densely nected parts f the graph nd pose-graph SLAM to we kly connected parts.”
BackgroundA Computationally Efficient Semantic SLAM Solution for Dynamic Scenes
Wang, Z., Zhang, Q., Li, J., Zhang, S., & Liu, J. (2019) · Remote Sensing · doi:10.3390/rs11111363 · Cited by 55
“[8], keyframe-based techniques are more accurate than filtering-based approaches.”
Method3D attention: measurement of visual saliency using eye tracking glasses
Paletta, L., Santner, K., Fritz, G., Mayer, H., & Schrammel, J. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468393 · Cited by 50
“Today, human attention gets investigated directly in the space where the task of interest is performed [e.g. 11].”
BackgroundMethodLategahn, H., & Stiller, C. (2012) · 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012) · doi:10.1109/icves.2012.6294279 · Cited by 49
“Very efficient solvers have recently emerged with [9], [18] being two examples.”
BackgroundMethodFrom Intrinsic Optimization to Iterated Extended Kalman Filtering on Lie Groups
Bourmaud, G., Mégret, R., Giremus, A., & Berthoumieu, Y. (2016) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-015-0622-8 · Cited by 65
“…transformation measurements, several works derived specific GN-like algorithms: [20] and [30] tackle the synchronization of rotations problem, [55] considers the consistent pose registration problem, [60] covers the partial 3D reconstruction merging problem, and [50] performs image mosaicing.”
BackgroundReal-Time CPU-Based Large-Scale Three-Dimensional Mesh Reconstruction
Piazza, E., Romanoni, A., & Matteucci, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800104 · Cited by 59
Robust optimization of factor graphs by using condensed measurements
Grisetti, G., Kummerle, R., & Ni, K. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385779 · Cited by 55
“Additionally, several approaches to Visual SLAM [20], [21] employ a similar concept like our approach.”
MethodMobile Robot Localization using GPS, IMU and Visual Odometry
Cai, G.-S., Lin, H., & Kao, S.-F. (2019) · International Automatic Control Conference · doi:10.1109/cacs47674.2019.9024731 · Cited by 46
Multi-camera parallel tracking and mapping with non-overlapping fields of view
Tribou, M. J., Harmat, A., Wang, D. W. L., Sharf, I., & Waslander, S. L. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915571429 · Cited by 50
“This is further refined by using one of the many existing loop-closure methods (Kümmerle et al., 2011; Strasdat et al., 2011) to constrain the solution and produce more accurate SLAM estimates.”
MethodInfluentialSafe and Robust Mobile Robot Navigation in Uneven Indoor Environments
Wang, C., Wang, J., Li, C., Ho, D., Cheng, J., Yan, T., Meng, L., & Meng, M. Q. ‐. (2019) · Sensors · doi:10.3390/s19132993 · Cited by 41
“Therefore, we utilize all the edges provided by the co− visibility graph [36] rather than using the essentialgraph in ORB-SLAM.”
A scene-adaptive descriptor for visual SLAM-based locating applications in built environments
Xu, L., Feng, C., Kamat, V. R., & Menassa, C. C. (2020) · Automation in Construction · doi:10.1016/j.autcon.2019.103067 · Cited by 40
Herrera-Granda, E. P., Torres, J. C., & Peluffo-Ordóñez, D. H. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37356 · Cited by 49
A 2.5D Map-Based Mobile Robot Localization via Cooperation of Aerial and Ground Robots
Nam, T. H., Shim, J., & Cho, Y. (2017) · Sensors · doi:10.3390/s17122730 · Cited by 41
PDLC-LIO: A Precise and Direct SLAM System Toward Large-Scale Environments With Loop Closures
Wang, S., Zhang, J., & Tan, X. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3307439 · Cited by 32
“Stereo cameras are widely utilized in numerous studies, which is inspired by human vision [5], [6], [7], [8].”
Accurate keyframe selection and keypoint tracking for robust visual odometry
Fanfani, M., Bellavia, F., & Colombo, C. (2016) · Machine Vision and Applications · doi:10.1007/s00138-016-0793-3 · Cited by 34
“In addition to the classical keypoint matching and tracking methods [17], solutions robust to high degrees of blur [29], relying on edges [18], with hierarchical pose refinement [32], or exploiting the high computational power offered by modern GPUs through a dense approach [25] have been proposed.”
BackgroundAccurate Monocular Visual-Inertial SLAM Using a Map-Assisted EKF Approach
Quan, M., Piao, S., Tan, M., & Huang, S.-S. (2019) · IEEE Access · doi:10.1109/access.2019.2904512 · Cited by 34
Efficient Map Compression for Collaborative Visual SLAM
Opdenbosch, D. V., Aykut, T., Alt, N., & Steinbach, E. G. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00114 · Cited by 30
Exploration-Based SLAM (e-SLAM) for the Indoor Mobile Robot Using Lidar
Ismail, H., Roy, R., Sheu, L.-J., Chieng, W.-H., & Tang, L. (2022) · Sensors · doi:10.3390/s22041689 · Cited by 36
Realizing, reversing, recovering: Incremental robust loop closing over time using the iRRR algorithm
Latif, Y., Cadena, C., & Neira, J. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385879 · Cited by 35
“SLAM algorithms that only generate local consistent maps such as [15] or [16] do not preserve the global geometric relationships between poses and therefore our method cannot be applied to them.”
MethodImproving accuracy of feature-based RGB-D SLAM by modeling spatial uncertainty of point features
Belter, D., Nowicki, M., & Skrzypczyński, P. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487259 · Cited by 30
“PUT SLAM shares also some concepts of the factor graph structure with [18].”
BackgroundMethodkRadar++: Coarse-to-Fine FMCW Scanning Radar Localisation
Martini, D. D., Gadd, M., & Newman, P. M. (2020) · Sensors · doi:10.3390/s20216002 · Cited by 28
“In this framework, a robot is driven along a desired path in a teach phase, during which it builds a topometric map [21,22] of the world by estimating its relative pose between consecutive keyframes.”
BackgroundElhashash, M., & Qin, R. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.03.018 · Cited by 32
Loop Detection and Correction of 3D Laser-Based SLAM with Visual Information
Zhu, Z., Yang, S., Dai, H., & Li, F. (2018) · Computer Animation (CA) · doi:10.1145/3205326.3205357 · Cited by 28
“[23] create a loop closure detection mechanism using bags of words [14] with SURF [1] features.”
MethodPlace recognition of 3D landmarks based on geometric relations
Rizzini, D. L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202220 · Cited by 27
Robotics: Science and Systems XI
(2015) · doi:10.15607/rss.2015.xi · Cited by 28
Fusion of optical flow and inertial measurements for robust egomotion estimation
Bloesch, M., Omari, S., Fankhauser, P., Sommer, H., Gehring, C., Hwangbo, J., Hoepflinger, M. A., Hutter, M., & Siegwart, R. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6942991 · Cited by 35
“the following, the limits of vision-only state estimation and mapping where pushed even further by various other elaborate delayed frameworks [13], [18], [9].”
BackgroundAn approach to solving large-scale SLAM problems with a small memory footprint
Suger, B., Tipaldi, G. D., Spinello, L., & Burgard, W. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907384 · Cited by 26
“[23] presented a double window optimization”
Inertial Navigation and Mapping for Autonomous Vehicles
Skoglund, M. A. (2014) · Linköping University Electronic Press eBooks · doi:10.3384/diss.diva-110373 · Cited by 26
“, 2011), 5 (Kim, 2013), 6 (Jung and Lacroix, 2003), 7 (Konolige and Agrawal, 2008; Cummins and Newman, 2010), 8 (Lupton and Sukkarieh, 2012; Karlsson and Bjärkefur, 2010; Strasdat et al., 2011; Jung and Taylor, 2001), 9 (Eustice et al.”
Research on SLAM and Path Planning Method of Inspection Robot in Complex Scenarios
Wang, X., Ma, X., & Li, Z. (2023) · Electronics · doi:10.3390/electronics12102178 · Cited by 29
SLAM-Based Self-Calibration of a Binocular Stereo Vision Rig in Real-Time
Yin, H., Ma, Z., Zhong, M., Wu, K. W., Wei, Y.-T., Guo, J., & Huang, B. (2020) · Sensors · doi:10.3390/s20030621 · Cited by 26
“Rather than using appropriate marginalization to accurately estimate this uncertainty, it is better to approximate the information matrix roughly as a diagonal matrix in the way proposed in [40]: Figure 5.”
MethodA Survey of UAV Visual Navigation Based on Monocular SLAM
Wei, W., Tan, L., Jin, G., Lu, L., & Sun, C. (2018) · IEEE Information Technology and Mechatronics Engineering Conference (ITOEC) · doi:10.1109/itoec.2018.8740355 · Cited by 27
“There are also several back-end optimization methods that adapt to larger scenes, the sliding window method [13] and the Factor Graph [14].”
MethodLineSLAM: Visual Real Time Localization Using Lines and UKF
Perdices, E., López, L. M., & Cañas, J. M. (2013) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-03413-3_49 · Cited by 26
“Recently, PTAM approach has been improved with new techniques to make it more robust [9].”
MethodSelf-Calibration and Visual SLAM with a Multi-Camera System on a Micro Aerial Vehicle
Heng, L., Lee, G. H., & Pollefeys, M. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.008 · Cited by 24
Metadata
- Authors
- Strasdat, H., Davison, A. J., Montiel, J. M. M., & Konolige, K.
- Affiliations
- Imperial College London (GB)
- Universidad de Zaragoza (ES)
- Venue
- 2011 International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2011-11
- Pages
- 2352-2359
- OpenAlex
- W2154280780
- Cited by
- 296
- References
- 21
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 9 · 2023: 13 · 2022: 25 · 2021: 20 · 2020: 30 · 2019: 33 · 2018: 31 · 2017: 30 · 2016: 23 · 2015: 34 · 2014: 15 · 2013: 21 · 2012: 5
- FWCI
- 25.35
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual SLAM, loop closure, monocular camera, stereo camera, RGB-D, dense 3D reconstruction, bundle adjustment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.