The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A scalable active framework for region annotation in 3D shape collections
Abstract
Large repositories of 3D shapes provide valuable input for data-driven analysis and modeling tools. They are especially powerful once annotated with semantic information such as salient regions and functional parts. We propose a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations. Given a shape collection and a user-specified region label our goal is to correctly demarcate the corresponding regions with minimal manual work. Our active framework achieves this goal by cycling between manually annotating the regions, automatically propagating these annotations across the rest of the shapes, manually verifying both human and automatic annotations, and learning from the verification results to improve the automatic propagation algorithm. We use a unified utility function that explicitly models the time cost of human input across all steps of our method. This allows us to jointly optimize for the set of models to annotate and for the set of models to verify based on the predicted impact of these actions on the human efficiency. We demonstrate that incorporating verification of all produced labelings within this unified objective improves both accuracy and efficiency of the active learning procedure. We automatically propagate human labels across a dynamic shape network using a conditional random field (CRF) framework, taking advantage of global shape-to-shape similarities, local feature similarities, and point-to-point correspondences. By combining these diverse cues we achieve higher accuracy than existing alternatives. We validate our framework on existing benchmarks demonstrating it to be significantly more efficient at using human input compared to previous techniques. We further validate its efficiency and robustness by annotating a massive shape dataset, labeling over 93,000 shape parts, across multiple model classes, and providing a labeled part collection more than one order of magnitude larger than existing ones.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · neural information processing systems · Cited by 2,132
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
Self-citationOn Visual Similarity Based 3D Model Retrieval
Chen, D., Tian, X., Shen, Y., & Ouhyoung, M. (2003) · Computer Graphics Forum · doi:10.1111/1467-8659.00669 · Cited by 1,398
Transforming classifier scores into accurate multiclass probability estimates
Zadrozny, B., & Elkan, C. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775151 · Cited by 1,280
A spectral technique for correspondence problems using pairwise constraints
Leordeanu, M., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.20 · Cited by 1,222
A benchmark for 3D mesh segmentation
Chen, X., Golovinskiy, A., & Funkhouser, T. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531379 · Cited by 654
A survey on Mesh Segmentation Techniques
Shamir, A. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01103.x · Cited by 593
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778839 · Cited by 469
Cited by
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Self-citationDynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
Self-citationPointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Qi, C. R., Su, H., Mo, K., & Guibas, L. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00593 · Cited by 2,817
Self-citationZhao, H., Jiang, L., Jia, J., Torr, P., & Koltun, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01595 · Cited by 2,476
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 2,114
Self-citationGuo, M.-H., Cai, J.-X., Liu, Z.-N., Mu, T.-J., Martin, R. R., & Hu, S.-M. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0229-5 · Cited by 2,100
“ding and self-attention), simple PCT (SPCT, with point embedding and offset-attention) and full PCT (with neighbor embedding and offset-attention) on two public datasets, ModelNet40 [32] and ShapeNet [36], giving a comprehensive comparison with other methods. The same soft cross-entropy loss function as [29] and the s…”
MethodInfluentialSelf-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
A survey on deep learning techniques for image and video semantic segmentation
Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., Martinez-Gonzalez, P., & Garcia-Rodriguez, J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.05.018 · Cited by 1,490
FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation
Yang, Y., Feng, C., Shen, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00029 · Cited by 1,313
Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models
Klokov, R., & Lempitsky, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.99 · Cited by 1,039
A Review on Deep Learning Techniques Applied to Semantic Segmentation
García-García, A., Orts‐Escolano, S., Oprea, S., Villena-Martínez, V., & García‐Rodríguez, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.06857 · Cited by 991
SO-Net: Self-Organizing Network for Point Cloud Analysis
Li, J., Chen, B. M., & Lee, G. H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00979 · Cited by 985
Relation-Shape Convolutional Neural Network for Point Cloud Analysis
Liu, Y., Fan, B., Xiang, S., & Pan, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00910 · Cited by 952
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling
Yu, X., Tang, L., Rao, Y., Huang, T., Zhou, J., & Lu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01871 · Cited by 801
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
Su, H., Jampani, V., Sun, D., Maji, S., Kalogerakis, E., Yang, M.-H., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00268 · Cited by 797
Self-citationNormalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation
Wang, H., Sridhar, S., Huang, J., Valentin, J., Song, S., & Guibas, L. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00275 · Cited by 757
Self-citationPointASNL: Robust Point Clouds Processing Using Nonlocal Neural Networks With Adaptive Sampling
Yan, X., Zheng, C., Li, Z., Wang, S., & Cui, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00563 · Cited by 672
Beyond Self-Attention: External Attention Using Two Linear Layers for Visual Tasks
Guo, M.-H., Liu, Z.-N., Mu, T.-J., & Hu, S.-M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3211006 · Cited by 668
Mo, K., Zhu, S., Chang, A. X., Yi, L., Tripathi, S., Guibas, L. J., & Su, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00100 · Cited by 667
Self-citationPointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding
Xie, S., Gu, J., Guo, D., Qi, C. R., Guibas, L., & Litany, O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_34 · Cited by 609
Self-citationMasked Autoencoders for Point Cloud Self-supervised Learning
Pang, Y., Wang, W., Tay, F. E. H., Liu, W., Tian, Y., & Yuan, L. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20086-1_35 · Cited by 605
SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation
Wang, W., Yu, R., Huang, Q., & Neumann, U. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00272 · Cited by 544
Self-citationPoint convolutional neural networks by extension operators
Atzmon, M., Maron, H., & Lipman, Y. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201301 · Cited by 542
Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling
Shen, Y., Feng, C., Yang, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00478 · Cited by 532
PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds
Xu, M., Ding, R., Zhao, H., & Qi, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00319 · Cited by 523
PF-Net: Point Fractal Network for 3D Point Cloud Completion
Huang, Z., Yu, Y., Xu, J., Ni, F., & Le, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00768 · Cited by 513
Recurrent Slice Networks for 3D Segmentation of Point Clouds
Huang, Q., Wang, W., & Neumann, U. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00278 · Cited by 510
Self-citationSyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation
Yi, L., Su, H., Guo, X., & Guibas, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.697 · Cited by 461
Self-citationPointGrid: A Deep Network for 3D Shape Understanding
Le, T., & Duan, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00959 · Cited by 432
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
ShellNet: Efficient Point Cloud Convolutional Neural Networks Using Concentric Shells Statistics
Zhang, Z., Hua, B.-S., & Yeung, S.-K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00169 · Cited by 409
Local Spectral Graph Convolution for Point Set Feature Learning
Wang, C., Samari, B., & Siddiqi, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_4 · Cited by 387
Review: Deep Learning on 3D Point Clouds
Bello, S. A., Yu, S., Wang, C., Adam, J. M., & Li, J. (2020) · Remote Sensing · doi:10.3390/rs12111729 · Cited by 387
3D Shape Segmentation with Projective Convolutional Networks
Kalogerakis, E., Averkiou, M., Maji, S., & Chaudhuri, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.702 · Cited by 368
Graph Neural Networks for Intelligent Transportation Systems: A Survey
Rahmani, S., Baghbani, A., Bouguila, N., & Patterson, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3257759 · Cited by 353
Zhao, Y., Birdal, T., Deng, H., & Tombari, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00110 · Cited by 351
Attentional ShapeContextNet for Point Cloud Recognition
Xie, S., Liu, S., Chen, Z., & Tu, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00484 · Cited by 334
GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud
Yi, L., Zhao, W., Wang, H., Sung, M., & Guibas, L. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00407 · Cited by 325
Self-citationLPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis
Liu, Z., Zhou, S., Suo, C., Yin, P., Chen, W., Wang, H., Li, H., & Liu, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00292 · Cited by 325
FeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis
Verma, N., Boyer, E., & Verbeek, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00275 · Cited by 324
RGCNN: Regularized Graph CNN for Point Cloud Segmentation
Te, G., Hu, W., Zheng, A., & Guo, Z. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240621 · Cited by 311
VV-Net: Voxel VAE Net With Group Convolutions for Point Cloud Segmentation
Meng, H.-Y., Gao, L., Lai, Y.-K., & Manocha, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00859 · Cited by 306
A Review of Deep Learning-Based Semantic Segmentation for Point Cloud
Zhang, J., Zhao, X., Chen, Z., & Lu, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2958671 · Cited by 306
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding
Afham, M., Dissanayake, I., Dissanayake, D., Dharmasiri, A., Thilakarathna, K., & Rodrigo, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00967 · Cited by 303
ConvPoint: Continuous convolutions for point cloud processing
Boulch, A. (2020) · Computers & Graphics · doi:10.1016/j.cag.2020.02.005 · Cited by 302
Walk in the Cloud: Learning Curves for Point Clouds Shape Analysis
Xiang, T., Zhang, C., Song, Y., Yu, J., & Cai, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00095 · Cited by 301
A-CNN: Annularly Convolutional Neural Networks on Point Clouds
Komarichev, A., Zhong, Z., & Hua, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00760 · Cited by 290
DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing
Liu, Y., Fan, B., Meng, G., Lu, J., Xiang, S., & Pan, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00534 · Cited by 288
Point Cloud Completion by Skip-Attention Network With Hierarchical Folding
Wen, X., Li, T., Han, Z., & Liu, Y.-S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00201 · Cited by 282
BSP-Net: Generating Compact Meshes via Binary Space Partitioning
Chen, Z., Tagliasacchi, A., & Zhang, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00012 · Cited by 279
Associatively Segmenting Instances and Semantics in Point Clouds
Wang, X., Liu, S., Shen, X., Shen, C., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00422 · Cited by 278
Geometric Back-Projection Network for Point Cloud Classification
Qiu, S., Anwar, S., & Barnes, N. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3074240 · Cited by 274
Where2Act: From Pixels to Actions for Articulated 3D Objects
Mo, K., Guibas, L., Mukadam, M., Gupta, A., & Tulsiani, S. (2021) · arXiv · doi:10.48550/arxiv.2101.02692 · Cited by 132
Self-citation3D AffordanceNet: A Benchmark for Visual Object Affordance Understanding
Deng, S., Xu, X., Wu, C., Chen, K., & Jia, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00182 · Cited by 124
Zero-shot visual reasoning through probabilistic analogical mapping
Webb, T. W., Fu, S., Bihl, T., Holyoak, K. J., & Lu, H. (2022) · arXiv · doi:10.48550/arxiv.2209.15087 · Cited by 18
3D CoMPaT: Composition of Materials on Parts of 3D Things
Li, Y., Upadhyay, U., Slim, H., Abdelreheem, A., Prajapati, A., Pothigara, S., Wonka, P., & Elhoseiny, M. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20074-8_7 · Cited by 13
Metadata
- Authors
- Yi, L., Kim, V. G., Ceylan, D., Shen, I.-C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., & Guibas, L.
- Venue
- ACM Transactions on Graphics
- Published
- 2016-11-11
- Volume
- 35
- Issue
- 6
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2553307952
- Cited by
- 1,231
- References
- 37
- FWCI
- 52.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.