The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A scalable active framework for region annotation in 3D shape collections
Abstract
Large repositories of 3D shapes provide valuable input for data-driven analysis and modeling tools. They are especially powerful once annotated with semantic information such as salient regions and functional parts. We propose a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations. Given a shape collection and a user-specified region label our goal is to correctly demarcate the corresponding regions with minimal manual work. Our active framework achieves this goal by cycling between manually annotating the regions, automatically propagating these annotations across the rest of the shapes, manually verifying both human and automatic annotations, and learning from the verification results to improve the automatic propagation algorithm. We use a unified utility function that explicitly models the time cost of human input across all steps of our method. This allows us to jointly optimize for the set of models to annotate and for the set of models to verify based on the predicted impact of these actions on the human efficiency. We demonstrate that incorporating verification of all produced labelings within this unified objective improves both accuracy and efficiency of the active learning procedure. We automatically propagate human labels across a dynamic shape network using a conditional random field (CRF) framework, taking advantage of global shape-to-shape similarities, local feature similarities, and point-to-point correspondences. By combining these diverse cues we achieve higher accuracy than existing alternatives. We validate our framework on existing benchmarks demonstrating it to be significantly more efficient at using human input compared to previous techniques. We further validate its efficiency and robustness by annotating a massive shape dataset, labeling over 93,000 shape parts, across multiple model classes, and providing a labeled part collection more than one order of magnitude larger than existing ones.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · neural information processing systems · Cited by 2,132
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
Self-citationOn Visual Similarity Based 3D Model Retrieval
Chen, D., Tian, X., Shen, Y., & Ouhyoung, M. (2003) · Computer Graphics Forum · doi:10.1111/1467-8659.00669 · Cited by 1,398
Transforming classifier scores into accurate multiclass probability estimates
Zadrozny, B., & Elkan, C. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775151 · Cited by 1,280
A spectral technique for correspondence problems using pairwise constraints
Leordeanu, M., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.20 · Cited by 1,222
A benchmark for 3D mesh segmentation
Chen, X., Golovinskiy, A., & Funkhouser, T. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531379 · Cited by 654
A survey on Mesh Segmentation Techniques
Shamir, A. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01103.x · Cited by 593
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778839 · Cited by 469
A probabilistic model for component-based shape synthesis
Kalogerakis, E., Chaudhuri, S., Koller, D., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185551 · Cited by 350
Crowdsourcing annotations for visual object detection
Su, H., Deng, J., & Fei-Fei, L. (2012) · National Conference on Artificial Intelligence · Cited by 328
Self-citationActive co-analysis of a set of shapes
Wang, Y., Asafi, S., van Kaick, O., Zhang, H., Cohen-Or, D., & Chen, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366184 · Cited by 258
3D Mesh Labeling via Deep Convolutional Neural Networks
Guo, K., Zou, D., & Chen, X. (2015) · ACM Transactions on Graphics · doi:10.1145/2835487 · Cited by 217
Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024160 · Cited by 211
Best of both worlds: Human-machine collaboration for object annotation
Russakovsky, O., Li, L.-J., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298824 · Cited by 204
Probabilistic reasoning for assembly-based 3D modeling
Chaudhuri, S., Kalogerakis, E., Guibas, L., & Koltun, V. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964930 · Cited by 198
Self-citationFunctional map networks for analyzing and exploring large shape collections
Huang, Q., Wang, F., & Guibas, L. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601111 · Cited by 171
Self-citationData-driven structural priors for shape completion
Sung, M., Kim, V. G., Angst, R., & Guibas, L. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818094 · Cited by 170
Self-citationProbabilistic reasoning for assembly-based 3D modeling
Chaudhuri, S., Kalogerakis, E., Guibas, L., & Koltun, V. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964930 · Cited by 168
Self-citationCo‐Segmentation of 3D Shapes via Subspace Clustering
Hu, R., Fan, L., & Liu, L. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03175.x · Cited by 159
Exploring collections of 3D models using fuzzy correspondences
Kim, V. G., Li, W., Mitra, N. J., DiVerdi, S., & Funkhouser, T. A. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185550 · Cited by 159
Self-citationUnsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024160 · Cited by 159
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. S. (2010) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1833349.1778839 · Cited by 150
Active learning for semantic segmentation with expected change
Vezhnevets, A. S., Buhmann, J. M., & Ferrari, V. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248050 · Cited by 145
Joint shape segmentation with linear programming
Huang, Q., Koltun, V., & Guibas, L. (2011) · doi:10.1145/2024156.2024159 · Cited by 139
Self-citationShape2Pose: human-centric shape analysis
Kim, V. G., Chaudhuri, S., Guibas, L., & Funkhouser, T. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601117 · Cited by 112
Self-citationStrong supervision from weak annotation: Interactive training of deformable part models
Branson, S., Perona, P., & Belongie, S. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126450 · Cited by 106
Unsupervised 3D shape segmentation and co-segmentation via deep learning
Shu, Z., Chengwu, Q., Xin, S., Hu, C., Wang, L., Zhang, Y., & Liu, L. (2016) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2016.02.015 · Cited by 99
3D Shape Segmentation and Labeling via Extreme Learning Machine
Xie, Z., Xu, K., Liu, L., & Xiong, Y. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12434 · Cited by 95
The Ignorant Led by the Blind: A Hybrid Human–Machine Vision System for Fine-Grained Categorization
Branson, S., Horn, G. V., Wah, C., Perona, P., & Belongie, S. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0698-4 · Cited by 85
Fine-grained semi-supervised labeling of large shape collections
Qi-xing Huang, A., Su, H., & Guibas, L. J. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508364 · Cited by 74
Self-citationMulti-Level Active Prediction of Useful Image Annotations for Recognition
Vijayanarasimhan, S., & Grauman, K. L. (2008) · neural information processing systems · Cited by 69
Annotation Propagation in Large Image Databases via Dense Image Correspondence
Rubinstein, M., Liu, C., & Freeman, W. T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_7 · Cited by 55
Interactive shape co-segmentation via label propagation
Wu, Z., Shou, R., Wang, Y., & Liu, X. (2013) · Computers & Graphics · doi:10.1016/j.cag.2013.11.009 · Cited by 42
Boyko, A., & Funkhouser, T. A. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647418 · Cited by 15
Learning 3D Part Detection from Sparsely Labeled Data
Makadia, A., & Yümer, M. E. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.108 · Cited by 10
Cited by
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Self-citationDynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
KPConv: Flexible and Deformable Convolution for Point Clouds
Thomas, H., Qi, C. R., Deschaud, J.-E., Marcotegui, B., Goulette, F., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,212
Self-citationPointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Qi, C. R., Su, H., Mo, K., & Guibas, L. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00593 · Cited by 2,817
Self-citationZhao, H., Jiang, L., Jia, J., Torr, P., & Koltun, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01595 · Cited by 2,476
Metadata
- Authors
- Yi, L., Kim, V. G., Ceylan, D., Shen, I.-C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., & Guibas, L.
- Venue
- ACM Transactions on Graphics
- Published
- 2016-11-11
- Volume
- 35
- Issue
- 6
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2553307952
- Cited by
- 1,231
- References
- 37
- FWCI
- 52.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.