The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Abstract
KinectFusion enables a user holding and moving a standard Kinect camera to rapidly create detailed 3D reconstructions of an indoor scene. Only the depth data from Kinect is used to track the 3D pose of the sensor and reconstruct, geometrically precise, 3D models of the physical scene in real-time. The capabilities of KinectFusion, as well as the novel GPU-based pipeline are described in full. Uses of the core system for low-cost handheld scanning, and geometry-aware augmented reality and physics-based interactions are shown. Novel extensions to the core GPU pipeline demonstrate object segmentation and user interaction directly in front of the sensor, without degrading camera tracking or reconstruction. These extensions are used to enable real-time multi-touch interactions anywhere, allowing any planar or non-planar reconstructed physical surface to be appropriated for touch.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Level Set Methods and Dynamic Implicit Surfaces
Osher, S., & Fedkiw, R. (2003) · Applied Mathematical Sciences · doi:10.1007/b98879 · Cited by 4,951
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008 · cited 2×
“As shown in [21], this allows us to mitigate issues of drift and reduce ICP errors, by tracking directly from the raycasted model as opposed to frame-to-frame ICP tracking.”
MethodSelf-citationEfficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
A volumetric method for building complex models from range images
Curless, B., & Levoy, M. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237269 · Cited by 3,124 · cited 5×
“This is normalized to a TSDF (lines 9 and 11) and averaged with the previous stored value using a simple running weighted average (line 13) [5].”
MethodInfluentialPoisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
Fast and Robust Multiframe Super Resolution
Farsiu, S., Robinson, M. D., Elad, M., & Milanfar, P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834669 · Cited by 2,090
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 3×
“the Kinect-based system of [12] reconstructs at ∼2Hz), or support real-time camera tracking but non real-time reconstruction or mapping phases [15, 19, 20].”
BackgroundMethodSelf-citationThe digital Michelangelo project
Levoy, M. (2003) · Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062) · doi:10.1109/im.1999.805329 · Cited by 1,608
Thrun, S. (2003) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 1,565
Level Set Methods and Dynamic Implicit Surfaces
Osher, Fedkiw, & Piechor (2004) · Applied Mechanics Reviews · doi:10.1115/1.1760520 · Cited by 1,184
RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
Real-time 3D model acquisition
Rusinkiewicz, S., Hall-Holt, O., & Levoy, M. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566600 · Cited by 576
Building Rome on a Cloudless Day
Frahm, J.-M., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., Lazebnik, S., et al. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_27 · Cited by 563
Live dense reconstruction with a single moving camera
Newcombe, R. A., & Davison, A. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539794 · Cited by 366
Self-citationReal-Time Visibility-Based Fusion of Depth Maps
Merrell, P., Akbarzadeh, A., Wang, L., Mordohai, P., Frahm, J.-M., Yang, R., Nister, D., & Pollefeys, M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408984 · Cited by 358
Real-time 3D model acquisition
Rusinkiewicz, S., Hall-Holt, O., & Levoy, M. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566600 · Cited by 319
3D shape scanning with a time-of-flight camera
Cui, Y., Schuon, S., Chan, D., Thrun, S., & Theobalt, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540082 · Cited by 293
Dynamic shape capture using multi-view photometric stereo
Vlasic, D., Peers, P., Baran, I., Debevec, P., Popović, J., Rusinkiewicz, S., & Matusik, W. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618520 · Cited by 238
Exploring Artificial Intelligence in the New Millenium
Wolter, F., & Zakharyaschev, M. (2002) · Research Portal (King's College London) · Cited by 206
Data-Parallel Octrees for Surface Reconstruction
Zhou, K., Gong, M., Huang, X. S., & Guo, B. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.75 · Cited by 182
In-hand scanning with online loop closure
Weise, T., Wismer, T., Leibe, B., & Gool, L. V. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457479 · Cited by 117
Fusion of range and color images for denoising and resolution enhancement with a non-local filter
Huhle, B., Schairer, T., Jenke, P., & Straßer, W. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.11.004 · Cited by 116 · cited 2×
“[12, 13]), which need to robustly and continuously detect sparse scene features, our approach to camera tracking avoids an explicit detection step, and directly works on the full depth maps acquired from the Kinect sensor.”
BackgroundMethodInteracting with dynamically defined information spaces using a handheld projector and a pen
Cao, X. S., & Balakrishnan, R. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166289 · Cited by 116
Robust and unobtrusive marker tracking on mobile phones
Wägner, D., Langlotz, T., & Schmalstieg, D. (2008) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2008.4637337 · Cited by 113
Cited by
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
“In [16] we discuss all these possibilities in detail.”
BackgroundSelf-citationSUN RGB-D: A RGB-D scene understanding benchmark suite
Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943
Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications
Khoshelham, K., & Elberink, S. O. (2012) · Sensors · doi:10.3390/s120201437 · Cited by 1,595
Enhanced Computer Vision With Microsoft Kinect Sensor: A Review
Han, J., Shao, L., Xu, D., & Shotton, J. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2265378 · Cited by 1,367
Self-citationDeferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Metadata
- Authors
- Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., & Fitzgibbon, A.
- Venue
- Proceedings of the 24th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2011-10-16
- Pages
- 559-568
- OpenAlex
- W2099940712
- Cited by
- 2,110
- References
- 28
- FWCI
- 273.60
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.