The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features
Open accessAbstract
A successful point cloud registration often lies on robust establishment of sparse matches through discriminative 3D local features. Despite the fast evolution of learning-based 3D feature descriptors, little attention has been drawn to the learning of 3D feature detectors, even less for a joint learning of the two tasks. In this paper, we leverage a 3D fully convolutional network for 3D point clouds, and propose a novel and practical learning mechanism that densely predicts both a detection score and a description feature for each 3D point. In particular, we propose a keypoint selection strategy that overcomes the inherent density variations of 3D point clouds, and further propose a self-supervised detector loss guided by the on-the-fly feature matching results during training. Finally, our method achieves state-of-the-art results in both indoor and outdoor scenarios, evaluated on 3DMatch and KITTI datasets, and shows its strong generalization ability on the ETH dataset. Towards practical use, we show that by adopting a reliable feature detector, sampling a smaller number of features is sufficient to achieve accurate and fast point cloud alignment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
Structure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433
3D is here: Point Cloud Library (PCL)
Rusu, R. B., & Cousins, S. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980567 · Cited by 4,885
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
SuperPoint: Self-Supervised Interest Point Detection and Description
DeTone, D., Malisiewicz, T., & Rabinovich, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00060 · Cited by 3,355
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Choy, C., Gwak, J., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00319 · Cited by 2,043
FastSLAM: a factored solution to the simultaneous localization and mapping problem
Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2002) · doi:10.5555/777092.777184 · Cited by 2,012
LIFT: Learned Invariant Feature Transform
Yi, K. M., Trulls, E., Lepetit, V., & Fua, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_28 · Cited by 1,202
D2-Net: A Trainable CNN for Joint Description and Detection of Local Features
Dusmanu, M., Rocco, I., Pajdla, T., Pollefeys, M., Sivic, J., Torii, A., & Sattler, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00828 · Cited by 1,179
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.29 · Cited by 1,128
SHOT: Unique signatures of histograms for surface and texture description
Salti, S., Tombari, F., & Di Stefano, L. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.04.011 · Cited by 987
SLAM++: Simultaneous Localisation and Mapping at the Level of Objects
Salas-Moreno, R. F., Newcombe, R. A., Strasdat, H., Kelly, P. H. J., & Davison, A. J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.178 · Cited by 945
Intrinsic shape signatures: A shape descriptor for 3D object recognition
Zhong, Y. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457637 · Cited by 823
Fully Convolutional Geometric Features
Choy, C., Park, J., & Koltun, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00905 · Cited by 759
PPFNet: Global Context Aware Local Features for Robust 3D Point Matching
Deng, H., Birdal, T., & Ilic, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00028 · Cited by 631
A Comprehensive Performance Evaluation of 3D Local Feature Descriptors
Guo, Y., Bennamoun, M., Sohel, F., Lu, M., Wan, J., & Kwok, N. M. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0824-y · Cited by 555
The Perfect Match: 3D Point Cloud Matching With Smoothed Densities
Gojcic, Z., Zhou, C., Wegner, J. D., & Wieser, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00569 · Cited by 530
Performance Evaluation of 3D Keypoint Detectors
Tombari, F., Salti, S., & Stefano, L. D. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0545-4 · Cited by 408
PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors
Deng, H., Birdal, T., & Ilic, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_37 · Cited by 400
3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration
Yew, Z. J., & Lee, G. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_37 · Cited by 392
R2D2: Repeatable and Reliable Detector and Descriptor
Revaud, J., Weinzaepfel, P., de Souza, C. R., Pion, N., Csurka, G., Cabon, Y., & Humenberger, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06195 · Cited by 334
LF-Net: Learning Local Features from Images
Ono, Y., Trulls, E., Fua, P., & Yi, K. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09662 · Cited by 322
Working hard to know your neighbor's margins: Local descriptor learning loss
Mishchuk, A., Mishkin, D., Radenović, F., & Matas, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10872 · Cited by 291
Challenging data sets for point cloud registration algorithms
Pomerleau, F., Liu, M., Colas, F., & Siegwart, R. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912458814 · Cited by 263
3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder
Elbaz, G., Avraham, T., & Fischer, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.265 · Cited by 241
ContextDesc: Local Descriptor Augmentation With Cross-Modality Context
Luo, Z., Shen, T., Zhou, L., Zhang, J., Yao, Y., Li, S., Fang, T., & Quan, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00263 · Cited by 228
Self-citationLearning Compact Geometric Features
Khoury, M., Zhou, Q.-Y., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.26 · Cited by 214
USIP: Unsupervised Stable Interest Point Detection From 3D Point Clouds
Li, J., & Lee, G. H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00045 · Cited by 209
GeoDesc: Learning Local Descriptors by Integrating Geometry Constraints
Luo, Z., Shen, T., Zhou, L., Zhu, S., Zhang, R., Yao, Y., Fang, T., & Quan, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_11 · Cited by 181
Self-citationUnsuperPoint: End-to-end Unsupervised Interest Point Detector and DescriptorPreprint
Christiansen, P., Kragh, M. F., Brodskiy, Y., & Karstoft, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04011 · Cited by 93
Fast and Accurate Registration of Structured Point Clouds with Small Overlaps
Ma, Y., Guo, Y., Zhao, J. C., Lu, M., Zhang, J., & Wan, J. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.86 · Cited by 40
Cited by
PREDATOR: Registration of 3D Point Clouds with Low Overlap
Huang, S., Gojcic, Z., Usvyatsov, M., Wieser, A., & Schindler, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00425 · Cited by 721
Geometric Transformer for Fast and Robust Point Cloud Registration
Qin, Z., Yu, H., Wang, C., Guo, Y., Peng, Y., & Xu, K. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01086 · Cited by 505
SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
Ao, S., Hu, Q., Yang, B., Markham, A., & Guo, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01158 · Cited by 397
Voxelized GICP for Fast and Accurate 3D Point Cloud Registration
Koide, K., Yokozuka, M., Oishi, S., & Banno, A. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9560835 · Cited by 386
PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency
Bai, X., Luo, Z., Zhou, L., Chen, H., Li, L., Hu, Z., Fu, H., & Tai, C.-L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01560 · Cited by 366
Self-citation
Metadata
- Authors
- Bai, X., Luo, Z., Zhou, L., Fu, H., Quan, L., & Tai, C.-L.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 6358-6366
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034675048
- Cited by
- 521
- References
- 37
- FWCI
- 51.34
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.