The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
Abstract
RGB-D cameras (such as the Microsoft Kinect) are novel sensing systems that capture RGB images along with per-pixel depth information. In this paper we investigate how such cameras can be used for building dense 3D maps of indoor environments. Such maps have applications in robot navigation, manipulation, semantic mapping, and telepresence. We present RGB-D Mapping, a full 3D mapping system that utilizes a novel joint optimization algorithm combining visual features and shape-based alignment. Visual and depth information are also combined for view-based loop-closure detection, followed by pose optimization to achieve globally consistent maps. We evaluate RGB-D Mapping on two large indoor environments, and show that it effectively combines the visual and shape information available from RGB-D cameras.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
Machine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
Closed-form solution of absolute orientation using unit quaternions
Horn, B. K. P. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.000629 · Cited by 4,116
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
Efficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945
Scalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
Accurate, Dense, and Robust Multiview Stereopsis
Furukawa, Y., & Ponce, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.161 · Cited by 3,019
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
MLESAC: A New Robust Estimator with Application to Estimating Image Geometry
Torr, P. H. S., & Zisserman, A. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.1999.0832 · Cited by 2,396
An efficient solution to the five-point relative pose problem
Nister, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.17 · Cited by 2,009
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
Debevec, P. E., Taylor, C. J., & Malik, J. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237191 · Cited by 1,905
Segal, A., Haehnel, D., & Thrun, S. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.021 · Cited by 1,526
Globally Consistent Range Scan Alignment for Environment Mapping
Lu, F., & Milios, E. (1997) · Autonomous Robots · doi:10.1023/a:1008854305733 · Cited by 1,304
Nistér, D., Naroditsky, O., & Bergen, J. R. (2004) · Cited by 1,169
Nister, D., Naroditsky, O., & Bergen, J. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315094 · Cited by 1,030
Surfels: surface elements as rendering primitives
Pfister, H., Zwicker, M., van Baar, J., & Gross, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344936 · Cited by 839
RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
Self-citationSBA: A software package for generic sparse bundle adjustment
Lourakis, M. I. A., & Argyros, A. A. (2009) · ACM Transactions on Mathematical Software · doi:10.1145/1486525.1486527 · Cited by 788
Detailed Real-Time Urban 3D Reconstruction from Video
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.-J., Merrell, P., et al. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0086-4 · Cited by 717
A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping
Thrun, S., Burgard, W., & Fox, D. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844077 · Cited by 686
Self-citationICP registration using invariant features
Sharp, G. C., Lee, S. W., & Wehe, D. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982886 · Cited by 614
FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping
Konolige, K., & Agrawal, M. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004832 · Cited by 532
(2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7 · Cited by 471
Live dense reconstruction with a single moving camera
Newcombe, R. A., & Davison, A. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539794 · Cited by 366
Reconstructing building interiors from images
Furukawa, Y., Curless, B., Seitz, S. M., & Szeliski, R. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459145 · Cited by 315
3D shape scanning with a time-of-flight camera
Cui, Y., Schuon, S., Chan, D., Thrun, S., & Theobalt, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540082 · Cited by 293
Registration and integration of textured 3-D data
Johnson, A. E., & Kang, S. B. (2002) · Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134) · doi:10.1109/im.1997.603871 · Cited by 259
Mapping Large Loops with a Single Hand-Held Camera
Clemente, L., Davison, A., Reid, I., Neira, J., & Tardos, J. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.038 · Cited by 248
A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent
Grisetti, G., Stachniss, C., Grzonka, S., & Burgard, W. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.009 · Cited by 216
Towards Urban 3D Reconstruction from Video
Akbarzadeh, A., Frahm, J.-M., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Merrell, P., Phelps, M., Sinha, S., Talton, B., et al. (2006) · Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06) · doi:10.1109/3dpvt.2006.141 · Cited by 182
Manipulator and object tracking for in-hand 3D object modeling
Krainin, M., Henry, P., Ren, X., & Fox, D. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911403178 · Cited by 166
Self-citationNavigating, Recognizing and Describing Urban Spaces With Vision and Lasers
Newman, P. M., Sibley, G., Smith, M., Cummins, M., Harrison, A., Mei, C., Posner, I., Shade, R., Schroeter, D., Murphy, L., et al. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364909341483 · Cited by 154
Sparse Sparse Bundle Adjustment
Konolige, K. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.102 · Cited by 151
Multi-view image and ToF sensor fusion for dense 3D reconstruction
Kim, Y. M., Theobalt, C., Diebel, J. R., Košecká, J., Miscusik, B., & Thrun, S. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457430 · Cited by 149
Efficient estimation of accurate maximum likelihood maps in 3D
Grisetti, G., Grzonka, S., Stachniss, C., Pfaff, P., & Burgard, W. (2007) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2007.4399030 · Cited by 148
Interactive 3D modeling of indoor environments with a consumer depth camera
Du, H. Y., Henry, P., Ren, X., Cheng, M., Goldman, D. B., Seitz, S. M., & Fox, D. (2011) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2030112.2030123 · Cited by 141
Self-citationKonolige, K. (2004) · National Conference on Artificial Intelligence · Cited by 140
Konolige, K. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509796 · Cited by 127
Three‐dimensional mapping with time‐of‐flight cameras
May, S., Droeschel, D., Holz, D., Fuchs, S., Malis, E., Nüchter, A., & Hertzberg, J. (2009) · Journal of Field Robotics · doi:10.1002/rob.20321 · Cited by 121
Keypoint Signatures for Fast Learning and Recognition
Calonder, M., Lepetit, V., & Fua, P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88682-2_6 · Cited by 71
CRF-Matching: Conditional Random Fields for Feature-Based Scan Matching
Ramos, F., Fox, D., & Durrant-Whyte, H. F. (2007) · Robotics: Science and Systems · doi:10.15607/rss.2007.iii.026 · Cited by 63
Self-citationImproving simultaneous mapping and localization in 3D using global constraints
Triebel, R., & Burgard, W. (2005) · National Conference on Artificial Intelligence · Cited by 46
Stereo-Vision Based 3D Modeling and Localization for Unmanned Vehicles
Se, S., & Jasiobedzki, P. (2008) · Cited by 35
6D scan registration using depth-interpolated local image features
Andreasson, H., & Lilienthal, A. J. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.09.011 · Cited by 33
Highly accurate maximum likelihood laser mapping by jointly optimizing laser points and robot poses
Ruhnke, M., Kummerle, R., Grisetti, G., & Burgard, W. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980220 · Cited by 15
Robust Ego-Motion Estimation with ToF Cameras.
Droeschel, D., May, S., Holz, D., Plöger, P.-G., & Behnke, S. (2009) · Cited by 13
Cited by
KinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
Enhanced Computer Vision With Microsoft Kinect Sensor: A Review
Han, J., Shao, L., Xu, D., & Shotton, J. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2265378 · Cited by 1,367
Real-time 3D reconstruction at scale using voxel hashing
Nießner, M., Zollhöfer, M., Izadi, S., & Stamminger, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508374 · Cited by 1,002
TEASER: Fast and Certifiable Point Cloud Registration
Yang, H., Shi, J., & Carlone, L. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3033695 · Cited by 895
3-D Mapping With an RGB-D Camera
Endres, F., Hess, J., Sturm, J., Cremers, D., & Burgard, W. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2279412 · Cited by 820
Metadata
- Authors
- Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2012-02-10
- Volume
- 31
- Issue
- 5
- Pages
- 647-663
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W1972671602
- Cited by
- 1,161
- References
- 51
- FWCI
- 208.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.