The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
GRASS: generative recursive autoencoders for shape structures
Abstract
We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which reflects fundamental intra-shape relationships such as adjacency and symmetry. We develop a recursive neural net (RvNN) based autoencoder to map a flat, unlabeled, arbitrary part layout to a compact code. The code effectively captures hierarchical structures of man-made 3D objects of varying structural complexities despite being fixed-dimensional: an associated decoder maps a code back to a full hierarchy. The learned bidirectional mapping is further tuned using an adversarial setup to yield a generative model of plausible structures, from which novel structures can be sampled. Finally, our structure synthesis framework is augmented by a second trained module that produces fine-grained part geometry, conditioned on global and local structural context, leading to a full generative pipeline for 3D shapes. We demonstrate that without supervision, our network learns meaningful structural hierarchies adhering to perceptual grouping principles, produces compact codes which enable applications such as shape classification and partial matching, and supports shape synthesis and interpolation with significant variations in topology and geometry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(2017) · International Conference on Machine Learning · Cited by 6,382
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
Convolutional Networks on Graphs for Learning Molecular Fingerprints
Duvenaud, D., Maclaurin, D., Aguilera-Iparraguirre, J., Gómez-Bombarelli, R., Hirzel, T., Aspuru-Guzik, A., & Adams, R. P. (2015) · arXiv · doi:10.48550/arxiv.1509.09292 · Cited by 2,628
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Volumetric and Multi-view CNNs for Object Classification on 3D Data
Qi, C. R., Su, H., NieBner, M., Dai, A., Yan, M., & Guibas, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.609 · Cited by 1,504
Self-citationSCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
Wu, J., Zhang, C., Xue, T., Freeman, W. T., & Tenenbaum, J. B. (2016) · arXiv · doi:10.48550/arxiv.1610.07584 · Cited by 1,393
Deep Convolutional Networks on Graph-Structured Data
Henaff, M., Bruna, J., & LeCun, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.05163 · Cited by 1,255
(2011) · Cited by 1,192
Procedural modeling of buildings
Müller, P., Wonka, P., Haegler, S., Ulmer, A., & Van Gool, L. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141931 · Cited by 950
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882311 · Cited by 913
Learning Convolutional Neural Networks for Graphs
Niepert, M., Ahmed, M. M., & Kutzkov, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.05273 · Cited by 775
Geodesic Convolutional Neural Networks on Riemannian Manifolds
Masci, J., Boscaini, D., Bronstein, M. M., & Vandergheynst, P. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.112 · Cited by 721
Learning a Predictable and Generative Vector Representation for Objects
Girdhar, R., Fouhey, D. F., Rodriguez, M., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_29 · Cited by 646
Autoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.09300 · Cited by 599
Convolutional-Recursive Deep Learning for 3D Object Classification
Socher, R., Huval, B., Bath, B., Manning, C. D., & Ng, A. Y. (2012) · neural information processing systems · Cited by 509
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073207 · Cited by 410
A probabilistic model for component-based shape synthesis
Kalogerakis, E., Chaudhuri, S., Koller, D., & Koltun, V. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185551 · Cited by 350
Self-citationLearning Shape Abstractions by Assembling Volumetric Primitives
Tulsiani, S., Su, H., Guibas, L. J., Efros, A. A., & Malik, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.160 · Cited by 321
Self-citationDeep Learning 3D Shape Surfaces Using Geometry Images
Sinha, A., Bai, J., & Ramani, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_14 · Cited by 298
Procedural modeling of buildings
Müller, P., Wonka, P., Haegler, S., Ulmer, A., & Van Gool, L. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141931 · Cited by 284
Learning part-based templates from large collections of 3D shapes
Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., & Funkhouser, T. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461933 · Cited by 230
Self-citationProbabilistic reasoning for assembly-based 3D modeling
Chaudhuri, S., Kalogerakis, E., Guibas, L., & Koltun, V. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964930 · Cited by 198
Self-citationA connection between partial symmetry and inverse procedural modeling
Bokeloh, M., Wand, M., & Seidel, H.-P. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778841 · Cited by 177
Structure-aware shape processing
Mitra, N., Wand, M., Zhang, H. (., Cohen-Or, D., Kim, V., & Huang, Q.-X. (2013) · SIGGRAPH Asia 2013 Courses · doi:10.1145/2542266.2542267 · Cited by 162
Self-citationExploration of continuous variability in collections of 3D shapes
Ovsjanikov, M., Li, W., Guibas, L., & Mitra, N. (2011) · ACM Transactions on Graphics · doi:10.1145/1964921.1964928 · Cited by 143
Self-citationLearning design patterns with bayesian grammar induction
Talton, J. O., Yang, L., Kumar, R., Lim, M., Goodman, N. D., & Měch, R. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380116.2380127 · Cited by 130
Exploratory modeling with collaborative design spaces
Talton, J. O., Gibson, D., Yang, L., Hanrahan, P., & Koltun, V. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618513 · Cited by 106
Exploring Shape Variations by 3D‐Model Decomposition and Part‐based Recombination
Jain, A., Thormählen, T., Ritschel, T., & Seidel, H. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03042.x · Cited by 90
Meta-representation of shape families
Fish, N., Averkiou, M., van Kaick, O. M., Sorkine‐Hornung, O., Cohen‐Or, D., & Mitra, N. J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601185 · Cited by 90
Co-hierarchical analysis of shape structures
van Kaick, O., Xu, K., Zhang, H., et al. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461924 · Cited by 89
Self-citationTopology-varying 3D shape creation via structural blending
Alhashim, I., Li, H., Xu, K., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601102 · Cited by 78
Self-citationShapeSynth: Parameterizing model collections for coupled shape exploration and synthesis
Averkiou, M., Kim, V. G., Zheng, Y., & Mitra, N. J. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12310 · Cited by 75
Analysis and synthesis of 3D shape families via deep‐learned generative models of surfaces
Huang, H., Kalogerakis, E., & Marlin, B. M. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12694 · Cited by 74
Analysis and synthesis of 3D shape families via deep-learned generative models of surfaces
Huang, H., Kalogerakis, E., & Marlin, B. M. (2015) · doi:10.5555/2853908.2853912 · Cited by 64
Encyclopedia of Computational Neuroscience
(2022) · Springer eBooks · doi:10.1007/978-1-0716-1006-0 · Cited by 64
Learning Semantic Deformation Flows with 3D Convolutional Networks
Yumer, M. E., & Mitra, N. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_18 · Cited by 60
A connection between partial symmetry and inverse procedural modeling
Bokeloh, M., Wand, M. D., & Seidel, H. (2010) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1833349.1778841 · Cited by 44
Hierarchical Models of the Visual System
Serre, T. (2015) · Springer eBooks · doi:10.1007/978-1-4614-6675-8_345 · Cited by 29
Exploratory modeling with collaborative design spaces
Talton, J. O., Gibson, D., Yang, L., Hanrahan, P., & Koltun, V. (2009) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1661412.1618513 · Cited by 25
Cited by
Learning Implicit Fields for Generative Shape Modeling
Chen, Z., & Zhang, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00609 · Cited by 1,443
Self-citationKato, H., Ushiku, Y., & Harada, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00411 · Cited by 954
A Papier-Mache Approach to Learning 3D Surface Generation
Groueix, T., Fisher, M., Kim, V. G., Russell, B. C., & Aubry, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00030 · Cited by 910
Mo, K., Zhu, S., Chang, A. X., Yi, L., Tripathi, S., Guibas, L. J., & Su, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00100 · Cited by 667
Self-citationImage-Based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
Han, X.-F., Laga, H., & Bennamoun, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2954885 · Cited by 431
Metadata
- Authors
- Li, J., Xu, K., Chaudhuri, S., Yumer, E., Zhang, H., & Guibas, L.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-14
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2612843093
- Cited by
- 296
- References
- 44
- FWCI
- 25.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.