The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
The Perfect Match: 3D Point Cloud Matching With Smoothed Densities
Open accessAbstract
We propose 3DSmoothNet, a full workflow to match 3D point clouds with a siamese deep learning architecture and fully convolutional layers using a voxelized smoothed density value (SDV) representation. The latter is computed per interest point and aligned to the local reference frame (LRF) to achieve rotation invariance. Our compact, learned, rotation invariant 3D point cloud descriptor achieves 94.9% average recall on the 3DMatch benchmark data set, outperforming the state-of-the-art by more than 20 percent points with only 32 output dimensions. This very low output dimension allows for near realtime correspondence search with 0.1 ms per feature point on a standard PC. Our approach is sensor- and scene-agnostic because of SDV, LRF and learning highly descriptive features with fully convolutional layers. We show that 3DSmoothNet trained only on RGB-D indoor scenes of buildings achieves 79.0% average recall on laser scans of outdoor vegetation, more than double the performance of our closest, learning-based competitors. Code, data and pre-trained models are available online at https://github.com/zgojcic/3DSmoothNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
(2010) · International Conference on Machine Learning · Cited by 13,995
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
3D is here: Point Cloud Library (PCL)
Rusu, R. B., & Cousins, S. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980567 · Cited by 4,885
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
Using spin images for efficient object recognition in cluttered 3D scenes
Johnson, A. E., & Hebert, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765655 · Cited by 2,599
Volumetric and Multi-view CNNs for Object Classification on 3D Data
Qi, C. R., Su, H., NieBner, M., Dai, A., Yan, M., & Guibas, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.609 · Cited by 1,504
Unique Signatures of Histograms for Local Surface Description
Tombari, F., Salti, S., & Di Stefano, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_26 · Cited by 1,480
FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation
Yang, Y., Feng, C., Shen, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00029 · Cited by 1,313
LIFT: Learned Invariant Feature Transform
Yi, K. M., Trulls, E., Lepetit, V., & Fua, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_28 · Cited by 1,202
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.29 · Cited by 1,128
Aligning point cloud views using persistent feature histograms
Rusu, R. B., Blodow, N., Marton, Z. C., & Beetz, M. (2008) · 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2008.4650967 · Cited by 1,034
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
Saxe, A., McClelland, J. L., & Ganguli, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6120 · Cited by 931
Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images
Shotton, J., Glocker, B., Zach, C., Izadi, S., Criminisi, A., & Fitzgibbon, A. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.377 · Cited by 930
SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels
Xiao, J., Owens, A., & Torralba, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.458 · Cited by 803
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3054739 · Cited by 662
PPFNet: Global Context Aware Local Features for Robust 3D Point Matching
Deng, H., Birdal, T., & Ilic, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00028 · Cited by 631
Rotational Projection Statistics for 3D Local Surface Description and Object Recognition
Guo, Y., Sohel, F., Bennamoun, M., Lu, M., & Wan, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0627-y · Cited by 609
L2-Net: Deep Learning of Discriminative Patch Descriptor in Euclidean Space
Tian, Y., Fan, B., & Wu, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.649 · Cited by 601
A Comprehensive Performance Evaluation of 3D Local Feature Descriptors
Guo, Y., Bennamoun, M., Sohel, F., Lu, M., Wan, J., & Kwok, N. M. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0824-y · Cited by 555
PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors
Deng, H., Birdal, T., & Ilic, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_37 · Cited by 400
Rotational projection statistics for 3D local surface description and object recognitionPreprint
Guo, Y., Sohel, F., Bennamoun, M., Lu, M., Wan, J., Guo, Y., Sohel, F., Bennamoun, M., Lu, M., & Wan, J. (2013) · Cited by 397
3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration
Yew, Z. J., & Lee, G. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_37 · Cited by 392
Learning SO(3) Equivariant Representations with Spherical CNNs
Esteves, C., Allen-Blanchette, C., Makadia, A., & Daniilidis, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_4 · Cited by 373
Unique shape context for 3d data description
Tombari, F., Salti, S., & Di Stefano, L. (2010) · Proceedings of the ACM workshop on 3D object retrieval · doi:10.1145/1877808.1877821 · Cited by 331
Unsupervised feature learning for 3D scene labeling
Lai, K., Bo, L., & Fox, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907298 · Cited by 317
Challenging data sets for point cloud registration algorithms
Pomerleau, F., Liu, M., Colas, F., & Siegwart, R. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912458814 · Cited by 263
3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder
Elbaz, G., Avraham, T., & Fischer, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.265 · Cited by 241
An integrated approach for modelling and global registration of point clouds
Rabbani, T., Dijkman, S., van den Heuvel, F., & Vosselman, G. (2007) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2006.09.006 · Cited by 231
Learning Compact Geometric Features
Khoury, M., Zhou, Q.-Y., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.26 · Cited by 214
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3126814 · Cited by 211
The 3D-3D Registration Problem Revisited
Li, H., & Hartley, R. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409077 · Cited by 191
TOLDI: An effective and robust approach for 3D local shape description
Yang, J., Zhang, Q., Xiao, Y., & Cao, Z. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.019 · Cited by 166
Learning to Navigate the Energy Landscape
Valentin, J., Dai, A., Nießner, M., Kohli, P., Torr, P. H. S., Izadi, S., & Keskin, C. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.41 · Cited by 161
Learning SO(3) Equivariant Representations with Spherical CNNs
Esteves, C., Allen-Blanchette, C., Makadia, A., & Daniilidis, K. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01220-1 · Cited by 147
Learning Local Shape Descriptors from Part Correspondences with Multiview Convolutional Networks
Huang, H., Kalogerakis, E., Chaudhuri, S., Ceylan, D., Kim, V. G., & Yumer, E. (2017) · ACM Transactions on Graphics · doi:10.1145/3137609 · Cited by 141
Thrift: Local 3D Structure Recognition
Flint, A., Dick, A., & van den Hengel, A. (2007) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2007.4426794 · Cited by 138
Point Pair Features Based Object Detection and Pose Estimation Revisited
Birdal, T., & Ilić, S. (2015) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2015.65 · Cited by 122
Globally consistent registration of terrestrial laser scans via graph optimization
Theiler, P. W., Wegner, J. D., & Konrad Schindler, B. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.08.007 · Cited by 121
Self-citationLearning to Assign Orientations to Feature Points
Yi, K. M., Verdié, Y., Fua, P., & Lepetit, V. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.19 · Cited by 120
Automatic Registration of RGB-D Scans via Salient Directions
Zeisl, B., Köser, K., & Pollefeys, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.349 · Cited by 49
LEARNED COMPACT LOCAL FEATURE DESCRIPTOR FOR TLS-BASED GEODETIC MONITORING OF NATURAL OUTDOOR SCENES
Gojčič, Ž., Zhou, C., & Wieser, A. (2018) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-2-113-2018 · Cited by 13
Self-citation
Cited by
Deep Closest Point: Learning Representations for Point Cloud Registration
Wang, Y., & Solomon, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00362 · Cited by 1,112
TEASER: Fast and Certifiable Point Cloud Registration
Yang, H., Shi, J., & Carlone, L. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3033695 · Cited by 895
Fully Convolutional Geometric Features
Choy, C., Park, J., & Koltun, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00905 · Cited by 759
PREDATOR: Registration of 3D Point Clouds with Low Overlap
Huang, S., Gojcic, Z., Usvyatsov, M., Wieser, A., & Schindler, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00425 · Cited by 721
Self-citationChoy, C., Dong, W., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00259 · Cited by 548
Metadata
- Authors
- Gojcic, Z., Zhou, C., Wegner, J. D., & Wieser, A.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 5540-5549
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964014140
- Cited by
- 530
- References
- 49
- FWCI
- 70.11
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.