SAL: Sign Agnostic Learning of Shapes From Raw Data
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Recently, neural networks have been used as implicit representations for surface reconstruction, modelling, learning, and generation. So far, training neural networks to be implicit representations of surfaces required training data sampled from a ground-truth signed implicit functions such as signed distance or occupancy functions, which are notoriously hard to compute. In this paper we introduce Sign Agnostic Learning (SAL), a deep learning approach for learning implicit shape representations directly from raw, unsigned geometric data, such as point clouds and triangle soups. We have tested SAL on the challenging problem of surface reconstruction from an un-oriented point cloud, as well as end-to-end human shape space learning directly from raw scans dataset, and achieved state of the art reconstructions compared to current approaches. We believe SAL opens the door to many geometric deep learning applications with real-world data, alleviating the usual painstaking, often manual pre-process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(2017) · Cited by 11,625
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37422 · Cited by 10,104
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37422 · Cited by 8,647
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
Park, J. J., Florence, P., Straub, J., Newcombe, R., & Lovegrove, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00025 · Cited by 3,422
Occupancy Networks: Learning 3D Reconstruction in Function Space
Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., & Geiger, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00459 · Cited by 2,708
Wendland, H. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511617539 · Cited by 2,538
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Screened poisson surface reconstruction
Kazhdan, M., & Hoppe, H. (2013) · ACM Transactions on Graphics · doi:10.1145/2487228.2487237 · Cited by 2,231
Poisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
Reconstruction and representation of 3D objects with radial basis functions
Carr, J. C., Beatson, R. K., Cherrie, J. B., Mitchell, T. J., Fright, W. R., McCallum, B. C., & Evans, T. R. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383266 · Cited by 1,852
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
The ball-pivoting algorithm for surface reconstruction
Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., & Taubin, G. (1999) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.817351 · Cited by 1,495
Learning Implicit Fields for Generative Shape Modeling
Chen, Z., & Zhang, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00609 · Cited by 1,443
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
Wu, J., Zhang, C., Xue, T., Freeman, W. T., & Tenenbaum, J. B. (2016) · arXiv · doi:10.48550/arxiv.1610.07584 · Cited by 1,393
A Papier-Mache Approach to Learning 3D Surface Generation
Groueix, T., Fisher, M., Kim, V. G., Russell, B. C., & Aubry, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00030 · Cited by 910
Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs
Tatarchenko, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.230 · Cited by 742
Shape Completion Using 3D-Encoder-Predictor CNNs and Shape Synthesis
Dai, A., Qi, C. R., & NieBner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.693 · Cited by 633
Understanding Deep Neural Networks with Rectified Linear UnitsPreprint
Arora, R., Basu, A., Mianjy, P., & Mukherjee, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01491 · Cited by 626
Deep SetsPreprint
Zaheer, M., Kottur, S., Ravanbakhsh, S., Póczos, B., Salakhutdinov, R., & Smola, A. J. (2017) · arXiv (Cornell University) · Cited by 528
A Survey of Surface Reconstruction from Point Clouds
Berger, M., Tagliasacchi, A., Seversky, L. M., Alliez, P., Guennebaud, G., Levine, J. A., Sharf, A., & Silva, C. T. (2017) · Computer Graphics Forum · doi:10.1111/cgf.12802 · Cited by 509
Estimating differential quantities using polynomial fitting of osculating jets
Cazals, F., & Pouget, M. (2005) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2004.09.004 · Cited by 437
Dynamic FAUST: Registering Human Bodies in Motion
Bogo, F., Romero, J., Pons-Moll, G., & Black, M. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.591 · Cited by 358
Learning Shape Templates With Structured Implicit Functions
Genova, K., Cole, F., Vlasic, D., Sarna, A., Freeman, W., & Funkhouser, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00725 · Cited by 323
Deep Learning 3D Shape Surfaces Using Geometry Images
Sinha, A., Bai, J., & Ramani, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_14 · Cited by 298
Convolutional neural networks on surfaces via seamless toric covers
Maron, H., Galun, M., Aigerman, N., Trope, M., Dym, N., Yumer, E., Kim, V. G., & Lipman, Y. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073616 · Cited by 231
Self-citationLearning 3D Shape Completion from Laser Scan Data with Weak Supervision
Stutz, D., & Geiger, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00209 · Cited by 229
Deformable Shape Completion with Graph Convolutional Autoencoders
Litany, O., Bronstein, A., Bronstein, M., & Makadia, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00202 · Cited by 226
CvxNet: Learnable Convex Decomposition
Deng, B., Genova, K., Yazdani, S., Bouaziz, S., Hinton, G., & Tagliasacchi, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00011 · Cited by 215
Deep Geometric Prior for Surface Reconstruction
Williams, F., Schneider, T., Silva, C., Zorin, D., Bruna, J., & Panozzo, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01037 · Cited by 208
Learning elementary structures for 3D shape generation and matchingPreprint
Deprelle, T., Groueix, T., Fisher, M., Kim, V. G., Russell, B. C., & Aubry, M. (2019) · HAL · doi:10.48550/arxiv.1908.04725 · Cited by 189
Optimizing the Latent Space of Generative Networks
Bojanowski, P., Joulin, A., López-Paz, D., & Szlam, A. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05776 · Cited by 185
SurfNet: Generating 3D Shape Surfaces Using Deep Residual Networks
Sinha, A., Unmesh, A., Huang, Q., & Ramani, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.91 · Cited by 159
Modeling Facial Geometry Using Compositional VAEs
Bagautdinov, T., Wu, C., Saragih, J., Fua, P., & Sheikh, Y. A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00408 · Cited by 134
Signing the Unsigned: Robust Surface Reconstruction from Raw Pointsets
Mullen, P., de Goes, F. F., Desbrun, M., Cohen‐Steiner, D., & Alliez, P. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2010.01782.x · Cited by 131
Controlling Neural Level SetsPreprint
Atzmon, M., Haim, N., Yariv, L., Israelov, O., Maron, H., & Lipman, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11911 · Cited by 116
Self-citationVariational implicit point set surfaces
Huang, Z., Carr, N., & Ju, T. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322994 · Cited by 97
Multi-chart generative surface modeling
Ben-Hamu, H., Maron, H., Kezurer, I., Avineri, G., & Lipman, Y. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275052 · Cited by 77
Self-citationImplicit surface modelling as an eigenvalue problem
Walder, C., Chapelle, O., & Schölkopf, B. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102469 · Cited by 21
Implicit Surfaces with Globally Regularised and Compactly Supported Basis Functions
Walder, C., Schölkopf, B., & Chapelle, O. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0039 · Cited by 12
Cited by
Efficient Geometry-aware 3D Generative Adversarial Networks
Chan, E. R., Lin, C. Z., Chan, M. A., Nagano, K., Pan, B., de Mello, S., Gallo, O., Guibas, L., Tremblay, J., Khamis, S., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01565 · Cited by 1,093
Learning Continuous Image Representation with Local Implicit Image Function
Chen, Y., Liu, S., & Wang, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00852 · Cited by 782
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
Chan, E. R., Monteiro, M., Kellnhofer, P., Wu, J., & Wetzstein, G. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00574 · Cited by 689
Neural Fields in Visual Computing and Beyond
Xie, Y., Takikawa, T., Saito, S., Litany, O., Yan, S., Khan, N., Tombari, F., Tompkin, J., sitzmann, V., & Sridhar, S. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14505 · Cited by 484
Space-time Neural Irradiance Fields for Free-Viewpoint Video
Xian, W., Huang, J.-B., Kopf, J., & Kim, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00930 · Cited by 357
Metadata
- Authors
- Atzmon, M., & Lipman, Y.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 2562-2571
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2991088502
- Cited by
- 433
- References
- 43
- FWCI
- 62.39
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.