The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
Open accessAbstract
Extracting robust and general 3D local features is key to downstream tasks such as point cloud registration and reconstruction. Existing learning-based local descriptors are either sensitive to rotation transformations, or rely on classical handcrafted features which are neither general nor representative. In this paper, we introduce a new, yet conceptually simple, neural architecture, termed SpinNet, to extract local features which are rotationally invariant whilst sufficiently informative to enable accurate registration. A Spatial Point Transformer is first introduced to map the input local surface into a carefully designed cylindrical space, enabling end-to-end optimization with SO(2) equivariant representation. A Neural Feature Extractor which leverages the powerful point-based and 3D cylindrical convolutional neural layers is then utilized to derive a compact and representative descriptor for matching. Extensive experiments on both indoor and outdoor datasets demonstrate that SpinNet outperforms existing state-of-the-art techniques by a large margin. More critically, it has the best generalization ability across unseen scenarios with different sensor modalities. The code is available at https://github.com/QingyongHu/SpinNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
Using spin images for efficient object recognition in cluttered 3D scenes
Johnson, A. E., & Hebert, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765655 · Cited by 2,599
Deep Learning for 3D Point Clouds: A Survey
Guo, Y., Wang, H., Hu, Q., Liu, H., Liu, L., & Bennamoun, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3005434 · Cited by 2,398
Self-citationRandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., & Markham, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01112 · Cited by 2,275
Self-citation4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Choy, C., Gwak, J., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00319 · Cited by 2,043
3D Semantic Segmentation with Submanifold Sparse Convolutional Networks
Graham, B., Engelcke, M., & Maaten, L. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00961 · Cited by 1,788
Unique Signatures of Histograms for Local Surface Description
Tombari, F., Salti, S., & Di Stefano, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_26 · Cited by 1,480
FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation
Yang, Y., Feng, C., Shen, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00029 · Cited by 1,313
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.29 · Cited by 1,128
Model globally, match locally: Efficient and robust 3D object recognition
Drost, B., Ulrich, M., Navab, N., & Ilic, S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540108 · Cited by 981
Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images
Shotton, J., Glocker, B., Zach, C., Izadi, S., Criminisi, A., & Fitzgibbon, A. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.377 · Cited by 930
Recognizing Objects in Range Data Using Regional Point Descriptors
Frome, A., Huber, D., Kolluri, R., Bülow, T., & Malik, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24672-5_18 · Cited by 885
Intrinsic shape signatures: A shape descriptor for 3D object recognition
Zhong, Y. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457637 · Cited by 823
SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels
Xiao, J., Owens, A., & Torralba, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.458 · Cited by 803
Fully Convolutional Geometric Features
Choy, C., Park, J., & Koltun, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00905 · Cited by 759
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3054739 · Cited by 662
PPFNet: Global Context Aware Local Features for Robust 3D Point Matching
Deng, H., Birdal, T., & Ilic, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00028 · Cited by 631
RPM-Net: Robust Point Matching Using Learned Features
Yew, Z. J., & Lee, G. H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01184 · Cited by 615
Rotational Projection Statistics for 3D Local Surface Description and Object Recognition
Guo, Y., Sohel, F., Bennamoun, M., Lu, M., & Wan, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0627-y · Cited by 609
Self-citation3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey
Guo, Y., Bennamoun, M., Sohel, F., Lu, M., & Wan, J. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2316828 · Cited by 600
Self-citationPoint Signatures: A New Representation for 3D Object Recognition
Chua, C. S., & Jarvis, R. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007981719186 · Cited by 587
Robust reconstruction of indoor scenes
Choi, S., Zhou, Q.-Y., & Koltun, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299195 · Cited by 555
A Comprehensive Performance Evaluation of 3D Local Feature Descriptors
Guo, Y., Bennamoun, M., Sohel, F., Lu, M., Wan, J., & Kwok, N. M. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0824-y · Cited by 555
Self-citationChoy, C., Dong, W., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00259 · Cited by 548
The Perfect Match: 3D Point Cloud Matching With Smoothed Densities
Gojcic, Z., Zhou, C., Wegner, J. D., & Wieser, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00569 · Cited by 530
D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features
Bai, X., Luo, Z., Zhou, L., Fu, H., Quan, L., & Tai, C.-L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00639 · Cited by 521
Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes
Mian, A. S., Bennamoun, M., & Owens, R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.213 · Cited by 502
Structural indexing: efficient 3-D object recognition
Stein, F., & Medioni, G. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121785 · Cited by 488
3D free-form object recognition in range images using local surface patches
Chen, H., & Bhanu, B. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2007.02.009 · Cited by 460
Mian, A., Bennamoun, M., & Owens, R. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0296-z · Cited by 417
Surface feature detection and description with applications to mesh matching
Zaharescu, A., Boyer, E., Varanasi, K., & Horaud, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206748 · Cited by 411
PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors
Deng, H., Birdal, T., & Ilic, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_37 · Cited by 400
Rotational projection statistics for 3D local surface description and object recognition
Guo, Y., Sohel, F., Bennamoun, M., Lu, M., Wan, J., Guo, Y., Sohel, F., Bennamoun, M., Lu, M., & Wan, J. (2013) · Murdoch University Research Portal · Cited by 399
Self-citation3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration
Yew, Z. J., & Lee, G. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_37 · Cited by 392
Learning SO(3) Equivariant Representations with Spherical CNNs
Esteves, C., Allen-Blanchette, C., Makadia, A., & Daniilidis, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_4 · Cited by 373
DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration
Lu, W., Wan, G., Zhou, Y., Fu, X., Yuan, P., & Song, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00010 · Cited by 307
Working hard to know your neighbor's margins: Local descriptor learning loss
Mishchuk, A., Mishkin, D., Radenović, F., & Matas, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10872 · Cited by 291
Challenging data sets for point cloud registration algorithms
Pomerleau, F., Liu, M., Colas, F., & Siegwart, R. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912458814 · Cited by 263
3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder
Elbaz, G., Avraham, T., & Fischer, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.265 · Cited by 241
Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds
Yang, B., Wang, J., Clark, R., Hu, Q., Wang, S., Markham, A., & Trigoni, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01140 · Cited by 229
Self-citationLearning Compact Geometric Features
Khoury, M., Zhou, Q.-Y., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.26 · Cited by 214
Learning to Navigate the Energy Landscape
Valentin, J., Dai, A., Nießner, M., Kohli, P., Torr, P. H. S., Izadi, S., & Keskin, C. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.41 · Cited by 199
The 3D-3D Registration Problem Revisited
Li, H., & Hartley, R. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409077 · Cited by 191
Learning Multiview 3D Point Cloud Registration
Gojcic, Z., Zhou, C., Wegner, J. D., Guibas, L. J., & Birdal, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00183 · Cited by 190
Chen, C., Li, G., Xu, R., Chen, T., Wang, M., & Lin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00513 · Cited by 181
Spherical Fractal Convolutional Neural Networks for Point Cloud Recognition
Rao, Y., Lu, J., & Zhou, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00054 · Cited by 167
End-to-End Learning Local Multi-View Descriptors for 3D Point Clouds
Li, L., Zhu, S., Fu, H., Tan, P., & Tai, C.-L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00199 · Cited by 145
On the repeatability of the local reference frame for partial shape matching
Petrelli, A., & Stefano, L. D. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126503 · Cited by 141
Novatnack, J., & Nishino, K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_33 · Cited by 137
3D Local Features for Direct Pairwise Registration
Deng, H., Birdal, T., & Ilić, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00336 · Cited by 124
Shape2Pose: human-centric shape analysis
Kim, V. G., Chaudhuri, S., Guibas, L., & Funkhouser, T. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601117 · Cited by 112
Quaternion Equivariant Capsule Networks for 3D Point Clouds
Zhao, Y., Birdal, T., Lenssen, J. E., Menegatti, E., Guibas, L. J., & Tombari, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_1 · Cited by 112
Pointwise Rotation-Invariant Network with Adaptive Sampling and 3D Spherical Voxel Convolution
You, Y., Lou, Y., Liu, Q., Tai, Y., Ma, L., Lu, C., & Wang, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6965 · Cited by 89
DeepSphere: a graph-based spherical CNNPreprint
Defferrard, M., Milani, M., Gusset, F., & Perraudin, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15000 · Cited by 87
Distinctive 3D local deep descriptors
Poiesi, F., & Boscaini, D. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9411978 · Cited by 63
Learning and Matching Multi-View Descriptors for Registration of Point Clouds
Zhou, L., Zhu, S., Luo, Z., Shen, T., Zhang, R., Zhen, M., Fang, T., & Quan, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_31 · Cited by 56
Deep Positional and Relational Feature Learning for Rotation-Invariant Point Cloud Analysis
Yu, R., Wei, X., Tombari, F., & Sun, J. Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_13 · Cited by 52
Learning an Effective Equivariant 3D Descriptor Without Supervision
Spezialetti, R., Salti, S., & Stefano, L. D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00650 · Cited by 48
Rotation-Invariant Local-to-Global Representation Learning for 3D Point CloudPreprint
Kim, S., Park, J., & Han, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03318 · Cited by 47
Fast and Accurate Registration of Structured Point Clouds with Small Overlaps
Ma, Y., Guo, Y., Zhao, J. C., Lu, M., Zhang, J., & Wan, J. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.86 · Cited by 40
Self-citationA repeatable and robust local reference frame for 3D surface matching
Ao, S., Guo, Y., Tian, J., Tian, Y., & Li, D. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107186 · Cited by 23
Self-citationCylindrical Convolutional Networks for Joint Object Detection and Viewpoint Estimation
Joung, S., Kim, S., Kim, H., Kim, M., Kim, I.-J., Cho, J., & Sohn, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01417 · Cited by 17
Cited by
Geometric Transformer for Fast and Robust Point Cloud Registration
Qin, Z., Yu, H., Wang, C., Guo, Y., Peng, Y., & Xu, K. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01086 · Cited by 505
Self-citationNot All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Clouds
Zhang, Y., Hu, Q., Xu, G., Ma, Y., Wan, J., & Guo, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01838 · Cited by 420
Self-citationPointDSC: Robust Point Cloud Registration using Deep Spatial Consistency
Bai, X., Luo, Z., Zhou, L., Chen, H., Li, L., Hu, Z., Fu, H., & Tai, C.-L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01560 · Cited by 366
GeoTransformer: Fast and Robust Point Cloud Registration With Geometric Transformer
Qin, Z., Yu, H., Wang, C., Guo, Y., Peng, Y., Ilic, S., Hu, D., & Xu, K. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3259038 · Cited by 279
Self-citation
Metadata
- Authors
- Ao, S., Hu, Q., Yang, B., Markham, A., & Guo, Y.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 11748-11757
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3167684723
- Cited by
- 397
- References
- 65
- FWCI
- 48.12
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.