The DOI matches its Crossref record; 160 of the 160 references it cites were found in a registry or an index.
Image-Based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
Open accessAbstract
3D reconstruction is a longstanding ill-posed problem, which has been explored for decades by the computer vision, computer graphics, and machine learning communities. Since 2015, image-based 3D reconstruction using convolutional neural networks (CNN) has attracted increasing interest and demonstrated an impressive performance. Given this new era of rapid evolution, this article provides a comprehensive survey of the recent developments in this field. We focus on the works which use deep learning techniques to estimate the 3D shape of generic objects either from a single or multiple RGB images. We organize the literature based on the shape representations, the network architectures, and the training mechanisms they use. While this survey is intended for methods which reconstruct generic objects, we also review some of the recent works which focus on specific object classes such as human body shapes and faces. We provide an analysis and comparison of the performance of some key papers, summarize some of the open problems in this field, and discuss promising directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37422 · Cited by 10,104
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37422 · Cited by 8,647
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
Structure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734 · cited 2×
“Parametric methods regularize the problem using statistical models such as morphable models [112], SCAPE [113], and SMPL [114].”
BackgroundMethodCaltech-UCSD Birds-200-2011 Dataset
Wah, C. (2024) · CaltechAUTHORS (California Institute of Technology) · doi:10.57702/i9oeewf6 · Cited by 3,525
3D Object Representations for Fine-Grained Categorization
Krause, J., Stark, M., Deng, J., & Fei-Fei, L. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.77 · Cited by 3,496
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
Park, J. J., Florence, P., Straub, J., Newcombe, R., & Lovegrove, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00025 · Cited by 3,422
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
A volumetric method for building complex models from range images
Curless, B., & Levoy, M. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237269 · Cited by 3,124
Multiple view geometry in computer vision
Opower, H. (2002) · Optics and Lasers in Engineering · doi:10.1016/s0143-8166(01)00145-2 · Cited by 3,007
Occupancy Networks: Learning 3D Reconstruction in Function Space
Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., & Geiger, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00459 · Cited by 2,708
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
Method for registration of 3-D shapes:
Besl, P. J., & McKay, N. D. (1992) · SPIE Proceedings · doi:10.1117/12.57955 · Cited by 2,413
A Point Set Generation Network for 3D Object Reconstruction from a Single Image
Fan, H., Su, H., & Guibas, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.264 · Cited by 2,402
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Screened poisson surface reconstruction
Kazhdan, M., & Hoppe, H. (2013) · ACM Transactions on Graphics · doi:10.1145/2487228.2487237 · Cited by 2,231
3D Semantic Parsing of Large-Scale Indoor Spaces
Armeni, I., Sener, O., Zamir, A. R., Jiang, H., Brilakis, I., Fischer, M., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.170 · Cited by 1,892
End-to-End Recovery of Human Shape and Pose
Kanazawa, A., Black, M. J., Jacobs, D. W., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00744 · Cited by 1,870
Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs
Monti, F., Boscaini, D., Masci, J., Rodola, E., Svoboda, J., & Bronstein, M. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.576 · Cited by 1,820
3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction
Choy, C. B., Xu, D., Gwak, J., Chen, K., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_38 · Cited by 1,632
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
OctNet: Learning Deep 3D Representations at High Resolutions
Riegler, G., Ulusoy, A. O., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.701 · Cited by 1,589
Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Bogo, F., Kanazawa, A., Lassner, C., Gehler, P., Romero, J., & Black, M. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_34 · Cited by 1,498
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
A Concise and Provably Informative Multi‐Scale Signature Based on Heat Diffusion
Sun, J., Ovsjanikov, M., & Guibas, L. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01515.x · Cited by 1,450
The visual hull concept for silhouette-based image understanding
Laurentini, A. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.273735 · Cited by 1,450
Learning Implicit Fields for Generative Shape Modeling
Chen, Z., & Zhang, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00609 · Cited by 1,443
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
Wu, J., Zhang, C., Xue, T., Freeman, W. T., & Tenenbaum, J. B. (2016) · arXiv · doi:10.48550/arxiv.1610.07584 · Cited by 1,393 · cited 10×
“Wu et al.’s work [3] has led to several extensions [7], [8], [17], [27], [40].”
BackgroundMethodInfluentialPixel2Mesh: Generating 3D Mesh Models from Single RGB Images
Wang, N., Zhang, Y., Li, Z., Fu, Y., Liu, W., & Jiang, Y.-G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_4 · Cited by 1,306
Semantic Scene Completion from a Single Depth Image
Song, S., Yu, F., Zeng, A., Chang, A. X., Savva, M., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.28 · Cited by 1,209
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
Kato, H., Ushiku, Y., & Harada, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00411 · Cited by 954
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882311 · Cited by 913
A Papier-Mache Approach to Learning 3D Surface Generation
Groueix, T., Fisher, M., Kim, V. G., Russell, B. C., & Aubry, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00030 · Cited by 910
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs
Tatarchenko, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.230 · Cited by 742
Beyond PASCAL: A benchmark for 3D object detection in the wild
Xiang, Y., Mottaghi, R., & Savarese, S. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836101 · Cited by 727
The space of human body shapes: reconstruction and parameterization from range scans
Allen, B., Curless, B., & Popović, Z. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882311 · Cited by 723
Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views
Su, H., Qi, C. R., Li, Y., & Guibas, L. J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.308 · Cited by 680
Learning a Predictable and Generative Vector Representation for Objects
Girdhar, R., Fouhey, D. F., Rodriguez, M., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_29 · Cited by 646
Shape Completion Using 3D-Encoder-Predictor CNNs and Shape Synthesis
Dai, A., Qi, C. R., & NieBner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.693 · Cited by 633
Joint 2D-3D-Semantic Data for Indoor Scene Understanding
Armeni, I., (Sasha), A. S., Zamir, A., & Savarese, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01105 · Cited by 621
Pix3D: Dataset and Methods for Single-Image 3D Shape ModelingPreprint
Sun, X., Wu, J., Zhang, X., Zhang, Z., Zhang, C.-K., Xue, T.-F., Tenenbaum, J., & Freeman, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1804.04610 · Cited by 538
Learning Category-Specific Mesh Reconstruction from Image Collections
Kanazawa, A., Tulsiani, S., Efros, A. A., & Malik, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_23 · Cited by 530
Multi-view Supervision for Single-View Reconstruction via Differentiable Ray Consistency
Tulsiani, S., Zhou, T., Efros, A. A., & Malik, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.30 · Cited by 519
Regressing Robust and Discriminative 3D Morphable Models with a Very Deep Neural Network
Tran, A. T., Hassner, T., Masi, I., & Medioni, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.163 · Cited by 503
Neural Body Fitting: Unifying Deep Learning and Model Based Human Pose and Shape Estimation
Omran, M., Lassner, C., Pons-Moll, G., Gehler, P., & Schiele, B. (2018) · 2018 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00062 · Cited by 498
Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling
Sun, X., Wu, J., Zhang, X., Zhang, Z., Zhang, C., Xue, T., Tenenbaum, J. B., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00314 · Cited by 455
Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression
Jackson, A. S., Bulat, A., Argyriou, V., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.117 · Cited by 449
OpenDR: An Approximate Differentiable Renderer
Loper, M. M., & Black, M. J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_11 · Cited by 441
Multi-Garment Net: Learning to Dress 3D People From Images
Bhatnagar, B., Tiwari, G., Theobalt, C., & Pons-Moll, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00552 · Cited by 439
What Do Single-View 3D Reconstruction Networks Learn?
Tatarchenko, M., Richter, S. R., Ranftl, R., Li, Z., Koltun, V., & Brox, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00352 · Cited by 424
Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
Lin, C.-H., Kong, C., & Lucey, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12278 · Cited by 385
BodyNet: Volumetric Inference of 3D Human Body Shapes
Varol, G., Ceylan, D., Russell, B., Yang, J., Yumer, E., Laptev, I., & Schmid, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_2 · Cited by 385
Spherical parametrization and remeshing
Praun, E., & Hoppe, H. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882274 · Cited by 383
Mesh Parameterization Methods and Their Applications
Sheffer, A., Praun, E., & Rose, K. (2006) · now publishers, Inc. eBooks · doi:10.1561/9781933019895 · Cited by 352
MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction
Tewari, A., Zollhofer, M., Kim, H., Garrido, P., Bernard, F., Perez, P., & Theobalt, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.401 · Cited by 343
Multi-view 3D Models from Single Images with a Convolutional Network
Tatarchenko, M., Dosovitskiy, A., & Brox, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_20 · Cited by 337
Learning Detailed Face Reconstruction from a Single Image
Richardson, E., Sela, M., Or-El, R., & Kimmel, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.589 · Cited by 336
Tex2Shape: Detailed Full Human Body Geometry From a Single Image
Alldieck, T., Pons-Moll, G., Theobalt, C., & Magnor, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00238 · Cited by 332
3D-RCNN: Instance-Level 3D Object Reconstruction via Render-and-Compare
Kundu, A., Li, Y., & Rehg, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00375 · Cited by 328
Learning to Reconstruct People in Clothing From a Single RGB Camera
Alldieck, T., Magnor, M., Bhatnagar, B. L., Theobalt, C., & Pons-Moll, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00127 · Cited by 326
Unsupervised Training for 3D Morphable Model Regression
Genova, K., Cole, F., Maschinot, A., Sarna, A., Vlasic, D., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00874 · Cited by 311
3D Face Reconstruction by Learning from Synthetic Data
Richardson, E., Sela, M., & Kimmel, R. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.56 · Cited by 309
Pix2Vox: Context-Aware 3D Reconstruction From Single and Multi-View Images
Xie, H., Yao, H., Sun, X., Zhou, S., & Zhang, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00278 · Cited by 306
Han, X., Li, Z., Huang, H., Kalogerakis, E., & Yu, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.19 · Cited by 304
Self-citationGRASS: generative recursive autoencoders for shape structures
Li, J., Xu, K., Chaudhuri, S., Yumer, E., Zhang, H., & Guibas, L. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073637 · Cited by 296
Pix2Vox: Context-Aware 3D Reconstruction From Single and Multi-View Images
Xie, H., Yao, H., Sun, X., Zhou, S., & Zhang, S. (2019) · IEEE Conference Proceedings · Cited by 294
Shape completion enabled robotic grasping
Varley, J., DeChant, C., Richardson, A., Ruales, J., & Allen, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206060 · Cited by 290
ObjectNet3D: A Large Scale Database for 3D Object Recognition
Xiang, Y., Kim, W., Chen, W., Ji, J., Choy, C., Su, H., Mottaghi, R., Guibas, L., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_10 · Cited by 282
Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation
Sela, M., Richardson, E., & Kimmel, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.175 · Cited by 280
Morphable Face Models - An Open Framework
Gerig, T., Morel-Forster, A., Blumer, C., Egger, B., Luthi, M., Schoenborn, S., & Vetter, T. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00021 · Cited by 268
Fundamentals of spherical parameterization for 3D meshes
Gotsman, C., Gu, X., & Sheffer, A. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882276 · Cited by 267
Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision
Yan, X., Yang, J., Yumer, E., Guo, Y., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00814 · Cited by 267
3D Shape Induction from 2D Views of Multiple Objects
Gadelha, M., Maji, S., & Wang, R. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00053 · Cited by 260
Deep Marching Cubes: Learning Explicit Surface Representations
Liao, Y., Donne, S., & Geiger, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00308 · Cited by 255
Parsing IKEA Objects: Fine Pose Estimation
Lim, J. J., Pirsiavash, H., & Torralba, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.372 · Cited by 249
Spherical parametrization and remeshing
Praun, E., & Hoppe, H. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882274 · Cited by 248
MarrNet: 3D Shape Reconstruction via 2.5D Sketches
Wu, J., Wang, Y., Xue, T., Sun, X., Freeman, W. T., & Tenenbaum, J. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03129 · Cited by 244
Multiresolution Tree Networks for 3D Point Cloud Processing
Gadelha, M., Wang, R., & Maji, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_7 · Cited by 242
Deformable Shape Completion with Graph Convolutional Autoencoders
Litany, O., Bronstein, A., Bronstein, M., & Makadia, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00202 · Cited by 226
SSD: Smooth Signed Distance Surface Reconstruction
Calakli, F., & Taubin, G. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.02058.x · Cited by 220
Vicente, S., Carreira, J., Agapito, L., & Batista, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.13 · Cited by 204
Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Prediction
Tulsiani, S., Efros, A. A., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00306 · Cited by 202
3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks
Zou, C., Yumer, E., Yang, J., Ceylan, D., & Hoiem, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.103 · Cited by 195
Adaptive O-CNN: a patch-based deep representation of 3D shapes
Wang, P.-S., Sun, C.-Y., Liu, Y., & Tong, X. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275050 · Cited by 193
3D Object Reconstruction from a Single Depth View with Adversarial Learning
Yang, B., Wen, H., Wang, S., Clark, R., Markham, A., & Trigoni, N. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.86 · Cited by 193
Fundamentals of spherical parameterization for 3D meshes
Gotsman, C., Gu, X., & Sheffer, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882276 · Cited by 191
3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks
Lun, Z., Gadelha, M., Kalogerakis, E., Maji, S., & Wang, R. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00018 · Cited by 189
Soltani, A. A., Huang, H., Wu, J., Kulkarni, T. D., & Tenenbaum, J. B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.269 · Cited by 186
Learning Shape Priors for Single-View 3D Completion And Reconstruction
Wu, J., Zhang, C., Zhang, X., Zhang, Z., Freeman, W. T., & Tenenbaum, J. B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_40 · Cited by 175
PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attention
Sun, Y., Wang, Y., Liu, Z., Siegel, J. E., & Sarma, S. E. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093430 · Cited by 175
Shape Inpainting Using 3D Generative Adversarial Network and Recurrent Convolutional Networks
Wang, W., Huang, Q., You, S., Yang, C., & Neumann, U. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.252 · Cited by 173
Learning to Reconstruct Shapes from Unseen ClassesPreprint
Zhang, X., Zhang, Z., Zhang, C.-K., Tenenbaum, J., Freeman, B., & Wu, J. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1812.11166 · Cited by 170
SurfNet: Generating 3D Shape Surfaces Using Deep Residual Networks
Sinha, A., Unmesh, A., Huang, Q., & Ramani, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.91 · Cited by 159
Izadinia, H., Shan, Q., & Seitz, S. M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.260 · Cited by 159
3D Sketching using Multi-View Deep Volumetric Prediction
Delanoy, J., Aubry, M., Isola, P., Efros, A. A., & Bousseau, A. (2017) · PACMCGIT · doi:10.1145/3203197 · Cited by 142
Dense 3D Object Reconstruction from a Single Depth View
Yang, B., Rosa, S., Markham, A., Trigoni, N., & Wen, H.-K. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2868195 · Cited by 135
Image2Mesh: A Learning Framework for Single Image 3D Reconstruction
Pontes, J. K., Kong, C., Sridharan, S., Lucey, S., Eriksson, A. P., & Fookes, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20887-5_23 · Cited by 134
GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction
Jiang, L., Shi, S., Qi, X., & Jia, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_49 · Cited by 130
Matryoshka Networks: Predicting 3D Geometry via Nested Shape Layers
Roth, S., & Richter, S. R. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00207 · Cited by 130
Dense 3D Point Cloud Reconstruction Using a Deep Pyramid Network
Mandikal, P., & Babu, R. V. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00117 · Cited by 129
DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image
Kurenkov, A., Ji, J., Garg, A., Mehta, V., Gwak, J., Choy, C., & Savarese, S. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00099 · Cited by 126
Im2Struct: Recovering 3D Shape Structure from a Single RGB Image
Niu, C., Li, J., & Xu, K. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00475 · Cited by 125
Deep Volumetric Video From Very Sparse Multi-view Performance Capture
Huang, Z., Li, T., Chen, W., Zhao, Y., Xing, J., LeGendre, C., Luo, L., Ma, C., & Li, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_21 · Cited by 123
Learning Where to Classify in Multi-view Semantic Segmentation
Riemenschneider, H., Bódis-Szomorú, A., Weissenberg, J., & Gool, L. V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10602-1_34 · Cited by 121
Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scene
Tulsiani, S., Gupta, S., Fouhey, D. F., Efros, A. A., & Malik, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00039 · Cited by 117
Human Shape from Silhouettes Using Generative HKS Descriptors and Cross-Modal Neural Networks
Dibra, E., Jain, H., Öztireli, C., Ziegler, R., & Groß, M. H. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.584 · Cited by 100
3D-PSRNet: Part Segmented 3D Point Cloud Reconstruction from a Single Image
Mandikal, P., Navaneet, K. L., & Babu, R. V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_50 · Cited by 100
Rethinking Reprojection: Closing the Loop for Pose-Aware Shape Reconstruction from a Single Image
Zhu, R., Galoogahi, H. K., Wang, C., & Lucey, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.16 · Cited by 97
HS-Nets: Estimating Human Body Shape from Silhouettes with Convolutional Neural Networks
Dibra, E., Jain, H., Öztireli, C., Ziegler, R., & Groß, M. H. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.19 · Cited by 89
Learning View Priors for Single-View 3D Reconstruction
Kato, H., & Harada, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01001 · Cited by 89
Deep Supervision with Shape Concepts for Occlusion-Aware 3D Object Parsing
Li, C., Zia, M. Z., Tran, Q.-H., Yu, X., Hager, G. D., & Chandraker, M. K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.49 · Cited by 86
Landmark‐Guided Elastic Shape Analysis of Spherically‐Parameterized Surfaces
Kurtek, S., Srivastava, A., Klassen, E., & Laga, H. (2013) · Computer graphics forum (Print) · doi:10.1111/cgf.12063 · Cited by 75
Self-citationLearning a Hierarchical Latent-Variable Model of 3D Shapes
Liu, S., Giles, L., & Ororbia, A. G. (2017) · International Conference on 3D Vision · doi:10.1109/3dv.2018.00068 · Cited by 68
Learning Category-Specific Deformable 3D Models for Object Reconstruction
Tulsiani, S., Kar, A., Carreira, J., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2574713 · Cited by 66
BodyNet: Volumetric Inference of 3D Human Body ShapesPreprint
Varol, G., Ceylan, D., Russell, B. C., Yang, J., Yumer, E., Ivan Laptev, A., & Schmid, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04875 · Cited by 63
Geometry-Aware Network for Non-rigid Shape Prediction from a Single View
Pumarola, A., Agudo, A., Porzi, L., Sanfeliu, A., Lepetit, V., & Moreno-Noguer, F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00492 · Cited by 61
Pix2Vex: Image-to-Geometry Reconstruction using a Smooth Differentiable RendererPreprint
Petersen, F., Bermano, A. H., Deußen, O., & Cohen‐Or, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11149 · Cited by 56
Numerical Inversion of SRNF Maps for Elastic Shape Analysis of Genus-Zero Surfaces
Laga, H., Xie, Q., Jermyn, I. H., & Srivastava, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2647596 · Cited by 51
Self-citationMVPNet: Multi-View Point Regression Networks for 3D Object Reconstruction from A Single Image
Wang, J., Sun, B., & Lu, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018949 · Cited by 49
Learning Priors for Semantic 3D Reconstruction
Cherabier, I., Schönberger, J. L., Oswald, M. R., Pollefeys, M., & Geiger, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_20 · Cited by 46
3D Face Reconstruction from Light Field Images: A Model-Free Approach
Feng, M., Gilani, S. Z., Wang, Y., & Mian, A. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_31 · Cited by 41
The Shape Space of 3D Botanical Tree Models
Wang, G., Laga, H., Xie, N., Jia, J.-Y., & Tabia, H. (2018) · ACM Transactions on Graphics · doi:10.1145/3144456 · Cited by 40
Self-citationImage-to-Voxel Model Translation with Conditional Adversarial Networks
Knyaz, V. A., Kniaz, V. V., & Fabio Remondino, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11009-3_37 · Cited by 39
Efficient Dense Point Cloud Object Reconstruction Using Deformation Vector Fields
Li, K., Pham, T. T., Zhan, H., & Reid, I. D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_31 · Cited by 37
Scaling CNNs for High Resolution Volumetric Reconstruction from a Single Image
Johnston, A., Garg, R., Carneiro, G., & Reid, I. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.114 · Cited by 34
Learning to Reconstruct High-Quality 3D Shapes with Cascaded Fully Convolutional Networks
Cao, Y., Liu, Z.-N., Kuang, Z., Kobbelt, L. P., & Hu, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_38 · Cited by 32
A Survey on Deep Learning Architectures for Image-based Depth ReconstructionPreprint
Laga, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06113 · Cited by 30
Self-citationDeep Disentangled Representations for Volumetric Reconstruction
Grant, E., Kohli, P., & van Gerven, M. A. J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49409-8_22 · Cited by 27
Weakly Supervised Generative Adversarial Networks for 3D Reconstruction.Preprint
Gwak, J., Choy, C., Garg, A., Chandraker, M. K., & Savarese, S. (2017) · arXiv (Cornell University) · Cited by 27
A Survey on Non-rigid 3D Shape Analysis
Laga, H. (2018) · arXiv.org · doi:10.1016/b978-0-12-811889-4.00007-5 · Cited by 26
Self-citationCompact Model Representation for 3D Reconstruction
Pontes, J. K., Kong, C., Eriksson, A. P., Fookes, C., Sridharan, S., & Lucey, S. (2017) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00020 · Cited by 25
RGB-D Image-Based Object Detection: From Traditional Methods to Deep Learning Techniques
Ward, I. R., Laga, H., & Bennamoun, M. (2019) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-28603-3_8 · Cited by 23
Self-citationStatistical Modeling of the 3D Geometry and Topology of Botanical Trees
Wang, G., Laga, H., Jia, J., Xie, N., & Tabia, H. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13501 · Cited by 18
Self-citationHierarchical Surface Prediction
Häne, C., Tulsiani, S., & Malik, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2896296 · Cited by 18
Inferring Point Clouds from Single Monocular Images by Depth IntermediationPreprint
Zeng, W., Karaoğlu, S., & Gevers, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01402 · Cited by 16
Single-view Object Shape Reconstruction Using Deep Shape Prior and SilhouettePreprint
Li, K., Garg, R., Cai, M., & Reid, I. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11921 · Cited by 14
Point Cloud GANPreprint
Li, C., Zaheer, M., Zhang, Y., et al. (2018) · arXiv (Cornell University) · Cited by 13
Zelek, J., & Lunscher, N. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.271 · Cited by 12
Capturing the Geometry of Object Categories from Video Supervision
Novotný, D., Larlus, D., & Vedaldi, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2871117 · Cited by 12
Cited by
Hands-On Bayesian Neural Networks—A Tutorial for Deep Learning Users
Jospin, L. V., Laga, H., Boussaid, F., Buntine, W., & Bennamoun, M. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2022.3155327 · Cited by 879
Self-citationArtificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
A Survey on Deep Learning Techniques for Stereo-Based Depth Estimation
Laga, H., Jospin, L. V., Boussaid, F., & Bennamoun, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032602 · Cited by 336
Self-citationMonoScene: Monocular 3D Semantic Scene Completion
Cao, A.-Q., & de Charette, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00396 · Cited by 293
Computer vision applications in construction: Current state, opportunities & challenges
Paneru, S., & Jeelani, I. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103940 · Cited by 287
Metadata
- Authors
- Han, X.-F., Laga, H., & Bennamoun, M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-05-01
- Volume
- 43
- Issue
- 5
- Pages
- 1578-1604
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2990026901
- Cited by
- 431
- References
- 160
- FWCI
- 30.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.