GAF-Net: Geometric Contextual Feature Aggregation and Adaptive Fusion for Large-Scale Point Cloud Semantic Segmentation
The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
Large-scale point cloud semantic segmentation is a challenging task due to the complexity and diversity of real-world 3D scenes. Most existing methods primarily rely on spatial coordinates to learn geometric representations without fully exploring local structural relationships. Additionally, the semantic gap between the encoder and decoder in segmentation networks is an important factor that constrains model performance. To address these challenges, we propose a novel network architecture called GAF-Net, which comprises a Geometric Contextual Feature Aggregation (GCFA) module and a Multi-scale Feature Adaptive Fusion (MFAF) module. The GCFA module consists of three primary blocks: (1) a Geometric Edge Representation block, designed to leverage spatial relative position and orientation information between the center point and its neighbors to capture detailed local geometric structural relations; (2) a Point Geometry Prior block, aimed at extracting explicit geometric priors for each point from raw point clouds. This block is lightweight and parameter-free; (3) a Geometry-Aware Attentive Pooling block, which combines semantic features with learned geometric representations, enabling the learning and aggregation of informative local contextual features. Our proposed MFAF module integrates multi-scale features by introducing an adaptive fusion approach. It effectively bridges the semantic gap between the encoder and decoder and mitigates the information loss caused by random sampling. Extensive experimental results on three large-scale benchmark datasets including S3DIS, Toronto3D, and SemanticKITTI demonstrate the superior performance of our proposed GAF-Net.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Dynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation
Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2959609 · Cited by 4,402
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
Zhao, H., Jiang, L., Jia, J., Torr, P., & Koltun, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01595 · Cited by 2,476
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., & Gall, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00939 · Cited by 2,294
RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., & Markham, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01112 · Cited by 2,275
Guo, M.-H., Cai, J.-X., Liu, Z.-N., Mu, T.-J., Martin, R. R., & Hu, S.-M. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0229-5 · Cited by 2,100 · cited 1×
“These methods can be mainly classified into three categories: graph-based method [14], [24], [25], [26], kernel-based method [27], [28], [29], [30], [31], and attention-based method [32], [33], [34], [35], [36].”
Method4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Choy, C., Gwak, J., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00319 · Cited by 2,043
3D Semantic Parsing of Large-Scale Indoor Spaces
Armeni, I., Sener, O., Zamir, A. R., Jiang, H., Brilakis, I., Fischer, M., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.170 · Cited by 1,892
PointConv: Deep Convolutional Networks on 3D Point Clouds
Wu, W., Qi, Z., & Fuxin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00985 · Cited by 1,850
3D Semantic Segmentation with Submanifold Sparse Convolutional Networks
Graham, B., Engelcke, M., & Maaten, L. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00961 · Cited by 1,788
OctNet: Learning Deep 3D Representations at High Resolutions
Riegler, G., Ulusoy, A. O., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.701 · Cited by 1,589
Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs
Landrieu, L., & Simonovsky, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00479 · Cited by 1,543
Volumetric and Multi-view CNNs for Object Classification on 3D Data
Qi, C. R., Su, H., NieBner, M., Dai, A., Yan, M., & Guibas, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.609 · Cited by 1,504
RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation
Milioto, A., Vizzo, I., Behley, J., & Stachniss, C. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967762 · Cited by 1,240
Wang, H., Cao, P., Wang, J., & Zaiane, O. R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20144 · Cited by 1,111
Relation-Shape Convolutional Neural Network for Point Cloud Analysis
Liu, Y., Fan, B., Xiang, S., & Pan, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00910 · Cited by 952
PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing
Zhao, H., Jiang, L., Fu, C.-W., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00571 · Cited by 840
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
Su, H., Jampani, V., Sun, D., Maji, S., Kalogerakis, E., Yang, M.-H., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00268 · Cited by 797
Graph Attention Convolution for Point Cloud Semantic Segmentation
Wang, L., Huang, Y., Hou, Y., Zhang, S., & Shan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01054 · Cited by 738
PointASNL: Robust Point Clouds Processing Using Nonlocal Neural Networks With Adaptive Sampling
Yan, X., Zheng, C., Li, Z., Wang, S., & Cui, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00563 · Cited by 672
Pointwise Convolutional Neural Networks
Hua, B.-S., Tran, M.-K., & Yeung, S.-K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00109 · Cited by 615
Tangent Convolutions for Dense Prediction in 3D
Tatarchenko, M., Park, J., Koltun, V., & Zhou, Q.-Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00409 · Cited by 593
PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation
Zhang, Y., Zhou, Z., David, P., Yue, X., Xi, Z., Gong, B., & Foroosh, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00962 · Cited by 590
Stratified Transformer for 3D Point Cloud Segmentation
Lai, X., Liu, J., Jiang, L., Wang, L., Zhao, H., Liu, S., Qi, X., & Jia, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00831 · Cited by 566
Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling
Shen, Y., Feng, C., Yang, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00478 · Cited by 532
PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds
Xu, M., Ding, R., Zhao, H., & Qi, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00319 · Cited by 523
Kanezaki, A., Matsushita, Y., & Nishida, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00526 · Cited by 504
ShellNet: Efficient Point Cloud Convolutional Neural Networks Using Concentric Shells Statistics
Zhang, Z., Hua, B.-S., & Yeung, S.-K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00169 · Cited by 409
Toronto-3D: A Large-scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadways
Tan, W., Qin, N., Ma, L., Li, Y., Du, J., Cai, G., Yang, K., & Li, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00109 · Cited by 307
SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation
Fan, S., Dong, Q., Zhu, F., Lv, Y., Ye, P., & Wang, F.-Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01427 · Cited by 306
Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework
Ma, X., Qin, C., You, H., Ran, H., & Fu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.07123 · Cited by 303
Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion
Qiu, S., Anwar, S., & Barnes, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00180 · Cited by 275
Geometric Back-Projection Network for Point Cloud Classification
Qiu, S., Anwar, S., & Barnes, N. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3074240 · Cited by 274
Surface Representation for Point Clouds
Ran, H., Liu, J., & Wang, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01837 · Cited by 245
Multiscale Diff-Changed Feature Fusion Network for Hyperspectral Image Change Detection
Luo, F., Zhou, T., Liu, J., Guo, T., Gong, X., & Ren, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3241097 · Cited by 236
Adaptive Graph Convolution for Point Cloud Analysis
Zhou, H., Feng, Y., Fang, M., Wei, M., Qin, J., & Lu, T. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00492 · Cited by 184
Learning Discriminative Features by Covering Local Geometric Space for Point Cloud Analysis
Wang, C., Ning, X., Sun, L., Zhang, L., Li, W., & Bai, X. P. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3170493 · Cited by 163
TGNet: Geometric Graph CNN on 3-D Point Cloud Segmentation
Li, Y., Ma, L., Zhong, Z., Cao, D., & Li, J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2958517 · Cited by 153
Ma, L., Li, Y., Li, J., Tan, W., Yu, Y., & Chapman, M. A. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2961060 · Cited by 148
Shuai, H., Xu, X., & Liu, Q. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3073660 · Cited by 116
Liu, C., Zeng, D., Akbar, A., Wu, H., Jia, S., Xu, Z., & Yue, H. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3182776 · Cited by 80
FA-ResNet: Feature affine residual network for large-scale point cloud segmentation
Zhan, L., Li, W., & Min, W. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103259 · Cited by 74
LEARD-Net: Semantic segmentation for large-scale point cloud scene
Zeng, Z., Xu, Y., Xie, Z., Tang, W., Wan, J., & Wu, W. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102953 · Cited by 67
LatticeNet: fast spatio-temporal point cloud segmentation using permutohedral lattices
Roşu, R. A., Schütt, P., Quenzel, J., & Behnke, S. (2021) · Autonomous Robots · doi:10.1007/s10514-021-09998-1 · Cited by 66
Xu, Y., Tang, W., Zeng, Z., Wu, W., Wan, J., Guo, H. W., & Xie, Z. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103285 · Cited by 63
DenseKPNET: Dense Kernel Point Convolutional Neural Networks for Point Cloud Semantic Segmentation
Li, Y., Li, X., Zhang, Z., Shuang, F., Lin, Q., & Jiang, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3162582 · Cited by 59
Yin, F., Huang, Z., Chen, T., Luo, G., Yu, G., & Fu, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3239541 · Cited by 57
Background-Aware 3-D Point Cloud Segmentation With Dynamic Point Feature Aggregation
Chen, J., Kakillioglu, B., & Velipasalar, S. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3168555 · Cited by 55
Learning Hybrid Semantic Affinity for Point Cloud Segmentation
Song, Z., Zhao, L., & Zhou, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3132047 · Cited by 50
ResDLPS-Net: Joint residual-dense optimization for large-scale point cloud semantic segmentation
Du, J., Cai, G., Wang, Z., Huang, S., Su, J., Marcato, J., Smit, J. L., & Li, J. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.024 · Cited by 48
Zeng, T., Luo, F., Guo, T., Gong, X., Xue, J., & Li, H. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3285207 · Cited by 38
A Dual Attention Neural Network for Airborne LiDAR Point Cloud Semantic Segmentation
Ka, Z., Ye, L., Xiao, W., Sheng, Y., Zhang, S., Xia, T., & Zhou, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3201902 · Cited by 35
PointGS: Bridging and fusing geometric and semantic space for 3D point cloud analysis
Jiang, C., Huang, K., Wu, J., Wang, X., Xiao, J., & Hussain, A. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.016 · Cited by 34
Zhao, Y., Ma, X., Hu, B., Zhang, Q., Ye, M., & Zhou, G. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.01.011 · Cited by 32
Using 2-Lines Congruent Sets for Coarse Registration of Terrestrial Point Clouds in Urban Scenes
Xu, E., Xu, Z., & Yang, K. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3128403 · Cited by 28
Mining local geometric structure for large-scale 3D point clouds semantic segmentation
Shao, Y., Tong, G., & Peng, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.060 · Cited by 21
Multilevel Context Feature Fusion for Semantic Segmentation of ALS Point Cloud
Zeng, T., Luo, F., Guo, T., Gong, X., Xue, J., & Li, H. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3294246 · Cited by 17
Chen, J., Chen, Y., & Wang, C. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3303399 · Cited by 12
A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation
Bi, Y., Zhang, L., Liu, Y., Huang, Y., & Liu, H. (2023) · IEEE Access · doi:10.1109/access.2023.3293161 · Cited by 11
Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
Zhang, F., & Xia, X. (2023) · IEEE Access · doi:10.1109/access.2023.3248963 · Cited by 5
Metadata
- Authors
- Zhou, C., & Ling, Q.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2023
- Volume
- 61
- Pages
- 1-15
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4389104901
- Cited by
- 284
- References
- 70
- FWCI
- 40.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.