The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion
Open accessAbstract
LiDAR point cloud analysis is a core task for 3D computer vision, especially for autonomous driving. However, due to the severe sparsity and noise interference in the single sweep LiDAR point cloud, the accurate semantic segmentation is non-trivial to achieve. In this paper, we propose a novel sparse LiDAR point cloud semantic segmentation framework assisted by learned contextual shape priors. In practice, an initial semantic segmentation (SS) of a single sweep point cloud can be achieved by any appealing network and then flows into the semantic scene completion (SSC) module as the input. By merging multiple frames in the LiDAR sequence as supervision, the optimized SSC module has learned the contextual shape priors from sequential LiDAR data, completing the sparse single sweep point cloud to the dense one. Thus, it inherently improves SS optimization through fully end-to-end training. Besides, a Point-Voxel Interaction (PVI) module is proposed to further enhance the knowledge fusion between SS and SSC tasks, i.e., promoting the interaction of incomplete local geometry of point cloud and complete voxel-wise global structure. Furthermore, the auxiliary SSC and PVI modules can be discarded during inference without extra burden for SS. Extensive experiments confirm that our JS3C-Net achieves superior performance on both SemanticKITTI and SemanticPOSS benchmarks, i.e., 4% and 3% improvement correspondingly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Dynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
Cipolla, R., Gal, Y., & Kendall, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00781 · Cited by 3,151
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Qi, C. R., Su, H., Mo, K., & Guibas, L. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00593 · Cited by 2,817
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., & Gall, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00939 · Cited by 2,294
RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., & Markham, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01112 · Cited by 2,275
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 2,114
4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Choy, C., Gwak, J., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00319 · Cited by 2,043
3D Semantic Parsing of Large-Scale Indoor Spaces
Armeni, I., Sener, O., Zamir, A. R., Jiang, H., Brilakis, I., Fischer, M., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.170 · Cited by 1,892
PointConv: Deep Convolutional Networks on 3D Point Clouds
Wu, W., Qi, Z., & Fuxin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00985 · Cited by 1,850
3D Semantic Segmentation with Submanifold Sparse Convolutional Networks
Graham, B., Engelcke, M., & Maaten, L. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00961 · Cited by 1,788
OctNet: Learning Deep 3D Representations at High Resolutions
Riegler, G., Ulusoy, A. O., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.701 · Cited by 1,589
Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs
Landrieu, L., & Simonovsky, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00479 · Cited by 1,543
RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation
Milioto, A., Vizzo, I., Behley, J., & Stachniss, C. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967762 · Cited by 1,240
Semantic Scene Completion from a Single Depth Image
Song, S., Yu, F., Zeng, A., Chang, A. X., Savva, M., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.28 · Cited by 1,209
Wu, B., Wan, A., Yue, X., & Keutzer, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462926 · Cited by 967
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
SEMANTIC3D.NET: A NEW LARGE-SCALE POINT CLOUD CLASSIFICATION BENCHMARK
Hackel, T., Savinov, N., Ladicky, L., Wegner, J. D., Schindler, K., & Pollefeys, M. (2017) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iv-1-w1-91-2017 · Cited by 812
Graph Attention Convolution for Point Cloud Semantic Segmentation
Wang, L., Huang, Y., Hou, Y., Zhang, S., & Shan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01054 · Cited by 738
Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution
Tang, H., Liu, Z., Zhao, S., Lin, Y., Lin, J., Wang, H., & Han, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58604-1_41 · Cited by 733
Wu, B., Zhou, X., Zhao, S., Yue, X., & Keutzer, K. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793495 · Cited by 726
PointASNL: Robust Point Clouds Processing Using Nonlocal Neural Networks With Adaptive Sampling
Yan, X., Zheng, C., Li, Z., Wang, S., & Cui, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00563 · Cited by 672
Self-citationTangent Convolutions for Dense Prediction in 3D
Tatarchenko, M., Park, J., Koltun, V., & Zhou, Q.-Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00409 · Cited by 593
PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation
Zhang, Y., Zhou, Z., David, P., Yue, X., Xi, Z., Gong, B., & Foroosh, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00962 · Cited by 590
SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentation
Xu, C., Wu, B., Wang, Z., Zhan, W., Vajda, P., Keutzer, K., & Tomizuka, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58604-1_1 · Cited by 430
Deep Projective 3D Semantic Segmentation
Lawin, F. J., Danelljan, M., Tosteberg, P., Bhat, G., Khan, F. S., & Felsberg, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-64689-3_8 · Cited by 342
ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans
Dai, A., Ritchie, D., Bokeloh, M., Reed, S., Sturm, J., & Niessner, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00481 · Cited by 311
Submanifold Sparse Convolutional Networks
Graham, B., & van der Maaten, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01307 · Cited by 308
Han, X., Li, Z., Huang, H., Kalogerakis, E., & Yu, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.19 · Cited by 304
Self-citationAssociatively Segmenting Instances and Semantics in Point Clouds
Wang, X., Liu, S., Shen, X., Shen, C., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00422 · Cited by 278
OccuSeg: Occupancy-Aware 3D Instance Segmentation
Han, L., Zheng, T., Xu, L., & Fang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00301 · Cited by 243
Unstructured Point Cloud Semantic Labeling Using Deep Segmentation Networks
Boulch, A., Saux, B. L., & Audebert, N. (2017) · Eurographics · doi:10.2312/3dor.20171047 · Cited by 241
Pham, Q.-H., Nguyen, T., Hua, B.-S., Roig, G., & Yeung, S.-K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00903 · Cited by 229
MeteorNet: Deep Learning on Dynamic 3D Point Cloud Sequences
Liu, X., Yan, M., & Bohg, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00934 · Cited by 220
Multi-Path Region Mining for Weakly Supervised 3D Semantic Segmentation on Point Clouds
Wei, J., Lin, G., Yap, K., Hung, T.-Y., & Xie, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00444 · Cited by 192
SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instances
Pan, Y., Gao, B., Mei, J., Geng, S., Li, C., & Zhao, H. (2020) · 2020 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/iv47402.2020.9304596 · Cited by 190
Point Cloud Oversegmentation With Graph-Structured Deep Metric Learning
Landrieu, L., & Boussaha, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00762 · Cited by 186
Alonso, I., Riazuelo, L., Montesano, L., & Murillo, A. C. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3007440 · Cited by 162
Efficient Semantic Scene Completion Network with Spatial Group Convolution
Zhang, J., Zhao, H., Yao, A., Chen, Y., Zhang, L., & Liao, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_45 · Cited by 145
SpSequenceNet: Semantic Segmentation Network on 4D Point Clouds
Shi, H., Lin, G., Wang, H., Hung, T.-Y., & Wang, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00463 · Cited by 126
RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion
Li, J., Liu, Y., Gong, D., Shi, Q., Yuan, X., Zhao, C., & Reid, I. D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00788 · Cited by 124
Self-citationTwo Stream 3D Semantic Scene Completion
Garbade, M., Chen, Y.-T., Sawatzky, J., & Gall, J. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00055 · Cited by 119
See and Think: Disentangling Semantic Scene Completion
Liu, S., Hu, Y. H., Zeng, Y., Tang, Q., Jin, B., Han, Y., & Li, X. (2018) · neural information processing systems · Cited by 117
PointConv: Deep Convolutional Networks on 3D Point CloudsPreprint
Wu, W., Qi, Z., & Li, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07246 · Cited by 100
PointRNN: Point Recurrent Neural Network for Moving Point Cloud Processing
Fan, H., & Yang, Y. (2019) · arXiv · doi:10.48550/arxiv.1910.08287 · Cited by 80
Han, X., Li, Z., Huang, H., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.07599 · Cited by 44
Self-citation3D Gated Recurrent Fusion for Semantic Scene CompletionPreprint
Liu, Y., Li, J., Yan, Q., Yuan, X., Zhao, C., Reid, I. D., & Cadena, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07269 · Cited by 25
Self-citation
Cited by
Tri-Perspective View for Vision-Based 3D Semantic Occupancy Prediction
Huang, Y., Zheng, W., Zhang, Y., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00890 · Cited by 312
MonoScene: Monocular 3D Semantic Scene Completion
Cao, A.-Q., & de Charette, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00396 · Cited by 293
2DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Clouds
Yan, X., Gao, J., Zheng, C., Zheng, C., Zhang, R., Cui, S., & Li, Z. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19815-1_39 · Cited by 280
Self-citationSurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Driving
Wei, Y., Zhao, L., Zheng, W., Zhu, Z., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01986 · Cited by 260
OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception
Wang, X., Zhu, Z., Xu, W., Zhang, Y., Wei, Y., Chi, X., Ye, Y., Du, D., Lu, J., & Wang, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01636 · Cited by 192
Metadata
- Authors
- Yan, X., Gao, J., Li, J., Zhang, R., Li, Z., Huang, R., & Cui, S.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2021-05-18
- Volume
- 35
- Issue
- 4
- Pages
- 3101-3109
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W3174692508
- Cited by
- 282
- References
- 50
- FWCI
- 34.37
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.