The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
ElasticFusion: Real-time dense SLAM and light source estimation
Abstract
We present a novel approach to real-time dense visual simultaneous localisation and mapping. Our system is capable of capturing comprehensive dense globally consistent surfel-based maps of room scale environments and beyond explored using an RGB-D camera in an incremental online fashion, without pose graph optimization or any post-processing steps. This is accomplished by using dense frame-to-model camera tracking and windowed surfel-based fusion coupled with frequent model refinement through non-rigid surface deformations. Our approach applies local model-to-model surface loop closure optimizations as often as possible to stay close to the mode of the map distribution, while utilizing global loop closure to recover from arbitrary drift and maintain global consistency. In the spirit of improving map quality as well as tracking accuracy and robustness, we furthermore explore a novel approach to real-time discrete light source detection. This technique is capable of detecting numerous light sources in indoor environments in real-time as a user handheld camera explores the scene. Absolutely no prior information about the scene or number of light sources is required. By making a small set of simple assumptions about the appearance properties of the scene our method can incrementally estimate both the quantity and location of multiple light sources in the environment in an online fashion. Our results demonstrate that our technique functions well in many different environments and lighting configurations. We show that this enables (a) more realistic augmented reality rendering; (b) a richer understanding of the scene beyond pure geometry and; (c) more accurate and robust photometric tracking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008 · cited 5×
“…alternation and effectively per-surface-element-independent filtering by holding the camera pose fixed during the mapping step (Keller et al., 2013; Newcombe et al., 2011a), which has proven to be a highly efficient technique capable of running in real-time even on resource constrained mobile…”
BackgroundMethodInfluentialSelf-citationMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 3×
“SLAM algorithms have too often targeted one of two extremes; (a) either extremely loopy motion in a very small area (e.g. MonoSLAM by Davison et al. (2007) or KinectFusion from Newcombe et al. (2011a)) or (b) “corridor-like” motion on much larger scales but with fewer loop closures (e.g. the work…”
BackgroundMethodSelf-citationDTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 7×
“In addition to this, as in previous work we assume tracking operates over a narrow baseline (Newcombe et al. (2011b)).”
BackgroundMethodInfluentialSelf-citationReal-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
Real-time 3D reconstruction at scale using voxel hashing
Nießner, M., Zollhöfer, M., Izadi, S., & Stamminger, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508374 · Cited by 1,002
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951
Dense visual SLAM for RGB-D cameras
Kerl, C., Sturm, J., & Cremers, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696650 · Cited by 909
A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM
Handa, A., Whelan, T., McDonald, J., & Davison, A. J. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907054 · Cited by 906
Self-citationElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
Self-citationAn evaluation of the RGB-D SLAM system
Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., & Burgard, W. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225199 · Cited by 731
Kintinuous: Spatially Extended KinectFusion
Whelan, T. J., Kaess, M., Fallon, M. F., Johannsson, H., Leonard, J. J., & McDonald, J. (2012) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 624
Self-citationFrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping
Konolige, K., & Agrawal, M. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004832 · Cited by 532
Embedded deformation for shape manipulation
Sumner, R. W., Schmid, J., & Pauly, M. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276478 · Cited by 449
Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion
Keller, M., Lefloch, D., Lambers, M., Izadi, S., Weyrich, T., & Kolb, A. (2013) · 2013 International Conference on 3D Vision · doi:10.1109/3dv.2013.9 · Cited by 384
Double window optimisation for constant time visual SLAM
Strasdat, H., Davison, A. J., Montiel, J. M. M., & Konolige, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126517 · Cited by 296
Self-citationVery High Frame Rate Volumetric Integration of Depth Images on Mobile Devices
Kahler, O., Adrian Prisacariu, V., Yuheng Ren, C., Sun, X., Torr, P., & Murray, D. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2459891 · Cited by 294
Scalable real-time volumetric surface reconstruction
Chen, J., Bautembach, D., & Izadi, S. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461940 · Cited by 247
Dense scene reconstruction with points of interest
Zhou, Q.-Y., & Koltun, V. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461919 · Cited by 229
Multi-resolution surfel maps for efficient dense 3D modeling and tracking
Stückler, J., & Behnke, S. (2014) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2013.02.008 · Cited by 209
Volumetric 3D mapping in real-time on a CPU
Steinbrücker, F., Sturm, J., & Cremers, D. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907127 · Cited by 178
Salas-Moreno, R. F., Glocken, B., Kelly, P. H. J., & Davison, A. J. (2014) · 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2014.6948422 · Cited by 175
Self-citationLarge-Scale Multi-resolution Surface Reconstruction from RGB-D Sequences
Steinbrucker, F., Kerl, C., & Cremers, D. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.405 · Cited by 158
Real-Time RGB-D Camera Relocalization via Randomized Ferns for Keyframe Encoding
Glocker, B., Shotton, J., Criminisi, A., & Izadi, S. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2360403 · Cited by 124
Self-citationIn-hand scanning with online loop closure
Weise, T., Wismer, T., Leibe, B., & Gool, L. V. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457479 · Cited by 117
Elastic Fragments for Dense Scene Reconstruction
Zhou, Q.-Y., Miller, S., & Koltun, V. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.65 · Cited by 114
On unifying key-frame and voxel-based dense visual SLAM at large scales
Meilland, M., & Comport, A. I. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696881 · Cited by 113
Real-time 6-DOF multi-session visual SLAM over large-scale environments
McDonald, J., Kaess, M., Cadena, C., Neira, J., & Leonard, J. J. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.08.008 · Cited by 101
Patch Volumes: Segmentation-Based Consistent Mapping with RGB-D Cameras
Henry, P., Fox, D., Bhowmik, A. K., & Mongia, R. K. (2013) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2013.59 · Cited by 96
Real-time surface light-field capture for augmentation of planar specular surfaces
Jachnik, J., Newcombe, R. A., & Davison, A. J. (2012) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2012.6402544 · Cited by 78
Self-citationLarge-scale and drift-free surface reconstruction using online subvolume registration
Fioraio, N., Taylor, J., Fitzgibbon, A. W., Stefano, L. D., & Izadi, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299077 · Cited by 69
KinÊtre: animating the world with the human body
Chen, J., Izadi, S., & Fitzgibbon, A. W. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380116.2380171 · Cited by 65
Cited by
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
“[15] builds a surfel-based map of the environment.”
BackgroundMethodInfluentialScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Labbé, M., & Michaud, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21831 · Cited by 989
2D Gaussian Splatting for Geometrically Accurate Radiance Fields
Huang, B., Yu, Z., Chen, A., Geiger, A., & Gao, S. (2024) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers · doi:10.1145/3641519.3657428 · Cited by 693
Metadata
- Authors
- Whelan, T., Salas-Moreno, R. F., Glocker, B., Davison, A. J., & Leutenegger, S.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2016-09-30
- Volume
- 35
- Issue
- 14
- Pages
- 1697-1716
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2527142681
- Cited by
- 698
- References
- 32
- FWCI
- 87.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.