The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
3D Shape Segmentation with Projective Convolutional Networks
Abstract
This paper introduces a deep architecture for segmenting 3D objects into their labeled semantic parts. Our architecture combines image-based Fully Convolutional Networks (FCNs) and surface-based Conditional Random Fields (CRFs) to yield coherent segmentations of 3D shapes. The image-based FCNs are used for efficient view-based reasoning about 3D object parts. Through a special projection layer, FCN outputs are effectively aggregated across multiple views and scales, then are projected onto the 3D object surfaces. Finally, a surface-based CRF combines the projected outputs with geometric consistency cues to yield coherent segmentations. The whole architecture (multi-view FCNs and CRF) is trained end-to-end. Our approach significantly outperforms the existing state-of-the-art methods in the currently largest segmentation benchmark (ShapeNet). Finally, we demonstrate promising segmentation results on noisy 3D shapes acquired from consumer-grade depth cameras.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
(2009) · Cited by 6,153
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
Self-citationIllumination for computer generated pictures
Phong, B. T. (1975) · Communications of the ACM · doi:10.1145/360825.360839 · Cited by 3,000
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 1×
“Several strategies for improving these initial estimates have been proposed including techniques based on top-down region-based reasoning [10, 16], CRFs [6, 31], atrous convolutional layers [6, 57], deconvolutional layers [35], recurrent networks [59], or a multiscale analysis [34, 17].”
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
(2013) · Cited by 2,056
SUN RGB-D: A RGB-D scene understanding benchmark suite
Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
Learning Rich Features from RGB-D Images for Object Detection and Segmentation
Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Volumetric and Multi-view CNNs for Object Classification on 3D Data
Qi, C. R., Su, H., NieBner, M., Dai, A., Yan, M., & Guibas, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.609 · Cited by 1,504
A large-scale hierarchical multi-view RGB-D object dataset
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980382 · Cited by 1,316
A scalable active framework for region annotation in 3D shape collections
Yi, L., Kim, V. G., Ceylan, D., Shen, I.-C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., & Guibas, L. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980238 · Cited by 1,231
Simultaneous Detection and Segmentation
Hariharan, B., Arbeláez, P., Girshick, R., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_20 · Cited by 1,085
FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-Based CNN Architecture
Hazirbas, C., Ma, L., Domokos, C., & Cremers, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54181-5_14 · Cited by 902
Efficient Piecewise Training of Deep Structured Models for Semantic Segmentation
Lin, G., Shen, C., van den Hengel, A., & Reid, I. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.348 · Cited by 862
Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images
Song, S., & Xiao, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.94 · Cited by 681
A benchmark for 3D mesh segmentation
Chen, X., Golovinskiy, A., & Funkhouser, T. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531379 · Cited by 654
Deep filter banks for texture recognition and segmentation
Cimpoi, M., Maji, S., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299007 · Cited by 646
Self-citationPerceptual Organization and Recognition of Indoor Scenes from RGB-D Images
Gupta, S., Arbelaez, P., & Malik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.79 · Cited by 595
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778839 · Cited by 469
Self-citationFeedforward semantic segmentation with zoom-out features
Mostajabi, M., Yadollahpour, P., & Shakhnarovich, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298959 · Cited by 436
Unsupervised Feature Learning for RGB-D Based Object Recognition
Bo, L., Ren, X., & Fox, D. (2013) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-00065-7_27 · Cited by 360
A probabilistic model for component-based shape synthesis
Kalogerakis, E., Chaudhuri, S., Koller, D., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185551 · Cited by 350
Self-citationLearning Dense Correspondence via 3D-Guided Cycle Consistency
Zhou, T., Krahenbuhl, P., Aubry, M., Huang, Q., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.20 · Cited by 350
Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision
Yan, X., Yang, J., Yumer, E., Guo, Y., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00814 · Cited by 267
Active co-analysis of a set of shapes
Wang, Y., Asafi, S., van Kaick, O., Zhang, H., Cohen-Or, D., & Chen, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366184 · Cited by 258
Learning part-based templates from large collections of 3D shapes
Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., & Funkhouser, T. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461933 · Cited by 230
Self-citation3D Mesh Labeling via Deep Convolutional Neural Networks
Guo, K., Zou, D., & Chen, X. (2015) · ACM Transactions on Graphics · doi:10.1145/2835487 · Cited by 217
Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024160 · Cited by 211
Probabilistic reasoning for assembly-based 3D modeling
Chaudhuri, S., Kalogerakis, E., Guibas, L., & Koltun, V. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964930 · Cited by 198
Self-citationA learned feature descriptor for object recognition in RGB-D data
Blum, M., Springenberg, J. T., Wulfing, J., & Riedmiller, M. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225188 · Cited by 189
A Large Dataset of Object ScansPreprint
Choi, S., Zhou, Q.-Y., Miller, S., & Koltun, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02481 · Cited by 173
Contextual Part Analogies in 3D Objects
Shapira, L., Shalom, S., Shamir, A., Cohen-Or, D., & Zhang, H. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0279-0 · Cited by 172
Functional map networks for analyzing and exploring large shape collections
Huang, Q., Wang, F., & Guibas, L. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601111 · Cited by 171
Probabilistic reasoning for assembly-based 3D modeling
Chaudhuri, S., Kalogerakis, E., Guibas, L., & Koltun, V. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964930 · Cited by 168
Self-citationReducing Snapshots to Points: A Visual Analytics Approach to Dynamic Network Exploration
van den Elzen, S., Holten, D., Blaas, J., & van Wijk, J. J. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2468078 · Cited by 160
Co‐Segmentation of 3D Shapes via Subspace Clustering
Hu, R., Fan, L., & Liu, L. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03175.x · Cited by 159
Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024160 · Cited by 159
3D Object Detection and Viewpoint Estimation with a Deformable 3D Cuboid Model
Fidler, S., Dickinson, S., & Urtasun, R. (2012) · doi:10.13140/2.1.2839.7440 · Cited by 149
Upright orientation of man-made objects
Fu, H., Cohen‐Or, D., Dror, G., et al. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360641 · Cited by 146
Joint shape segmentation with linear programming
Huang, Q., Koltun, V., & Guibas, L. (2011) · doi:10.1145/2024156.2024159 · Cited by 139
Single-view reconstruction via joint analysis of image and shape collections
Huang, Q., Wang, H., & Koltun, V. (2015) · ACM Transactions on Graphics · doi:10.1145/2766890 · Cited by 138
Attribit: content creation with semantic attributes
Chaudhuri, S., Kalogerakis, E., Giguere, S., & Funkhouser, T. A. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502008 · Cited by 133
Self-citationData-driven shape analysis and processing
Xu, K., Kim, V. G., Huang, Q., Mitra, N. J., & Kalogerakis, E. (2016) · SIGGRAPH Asia Courses · doi:10.1145/2988458.2988473 · Cited by 107
Self-citationPrior Knowledge for Part Correspondence
van Kaick, O. M., Tagliasacchi, A., Sidi, O., Zhang, H., Cohen‐Or, D., Wolf, L., & Hamarneh, G. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01893.x · Cited by 102
Shape Synthesis from Sketches via Procedural Models and Convolutional Networks
Huang, H., Kalogerakis, E., Yumer, E., & Měch, R. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2597830 · Cited by 90
Self-citationMulti-View and 3D Deformable Part Models
Pepik, B., Stark, M. M., Gehler, P., & Schiele, B. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408347 · Cited by 83
FPM: Fine Pose Parts-Based Model with 3D CAD Models
Lim, J. J., Khosla, A., & Torralba, A. B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_31 · Cited by 77
Projective Feature Learning for 3D Shapes with Multi-View Depth Images
Xie, Z., Xu, K., Shan, W., Liu, L., Xiong, Y., & Huang, H. F. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12740 · Cited by 76
Projective analysis for 3D shape segmentation
Wang, Y., Gong, M., Wang, T., Cohen‐Or, D., Zhang, H., & Chen, B. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508393 · Cited by 74
Analysis and synthesis of 3D shape families via deep‐learned generative models of surfaces
Huang, H., Kalogerakis, E., & Marlin, B. M. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12694 · Cited by 74
Self-citationAnalysis and synthesis of 3D shape families via deep-learned generative models of surfaces
Huang, H., Kalogerakis, E., & Marlin, B. M. (2015) · doi:10.5555/2853908.2853912 · Cited by 64
Self-citationFunctionality preserving shape style transfer
Lun, Z., Kalogerakis, E., Wang, R., & Sheffer, A. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980237 · Cited by 41
Self-citation
Cited by
Kato, H., Ushiku, Y., & Harada, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00411 · Cited by 954
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
Su, H., Jampani, V., Sun, D., Maji, S., Kalogerakis, E., Yang, M.-H., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00268 · Cited by 797
Self-citationMeshCNN: a network with an edge
Hanocka, R., Hertz, A., Fish, N., Giryes, R., Fleishman, S., & Cohen-Or, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322959 · Cited by 742
Tangent Convolutions for Dense Prediction in 3D
Tatarchenko, M., Park, J., Koltun, V., & Zhou, Q.-Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00409 · Cited by 593
3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans
Hou, J., Dai, A., & NieBner, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00455 · Cited by 483
Metadata
- Authors
- Kalogerakis, E., Averkiou, M., Maji, S., & Chaudhuri, S.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 6630-6639
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2565662353
- Cited by
- 368
- References
- 60
- FWCI
- 75.06
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.