The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Open accessAbstract
A longstanding question in computer vision concerns the representation of 3D shapes for recognition: should 3D shapes be represented with descriptors operating on their native 3D formats, such as voxel grid or polygon mesh, or can they be effectively represented with view-based descriptors? We address this question in the context of learning to recognize 3D shapes from a collection of their rendered views on 2D images. We first present a standard CNN architecture trained to recognize the shapes' rendered views independently of each other, and show that a 3D shape can be recognized even from a single view at an accuracy far higher than using state-of-the-art 3D shape descriptors. Recognition rates further increase when multiple views of the shapes are provided. In addition, we present a novel CNN architecture that combines information from multiple views of a 3D shape into a single and compact shape descriptor offering even better recognition performance. The same architecture can be applied to accurately recognize human hand-drawn sketches of shapes. We conclude that a collection of 2D views can be highly informative for 3D shape recognition and is amenable to emerging CNN architectures and their derivatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 6×
“Another advantage of using 2D representations is that we can leverage (i) advances in image descriptors [22, 26] and (ii) massive image databases (such as ImageNet [9]) to pre-train our CNN architectures.”
MethodInfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 12×
“Our method is related to prior work on shape descriptors for 3D objects and image-based CNNs.”
MethodInfluential
Cited by
Items 101–137 of 137
A Review of Deep Learning-Based Semantic Segmentation for Point Cloud
Zhang, J., Zhao, X., Chen, Z., & Lu, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2958671 · Cited by 306
Review of Pavement Defect Detection Methods
Cao, W., Liu, Q., & He, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2966881 · Cited by 304
ConvPoint: Continuous convolutions for point cloud processing
Boulch, A. (2020) · Computers & Graphics · doi:10.1016/j.cag.2020.02.005 · Cited by 302
Walk in the Cloud: Learning Curves for Point Clouds Shape Analysis
Xiang, T., Zhang, C., Song, Y., Yu, J., & Cai, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00095 · Cited by 301
Group-Free 3D Object Detection via Transformers
Liu, Z., Zhang, Z., Cao, Y., Hu, H., & Tong, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00294 · Cited by 298
Deep Learning 3D Shape Surfaces Using Geometry Images
Sinha, A., Bai, J., & Ramani, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_14 · Cited by 298
GRASS: generative recursive autoencoders for shape structures
Li, J., Xu, K., Chaudhuri, S., Yumer, E., Zhang, H., & Guibas, L. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073637 · Cited by 296
A-CNN: Annularly Convolutional Neural Networks on Point Clouds
Komarichev, A., Zhong, Z., & Hua, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00760 · Cited by 290
DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing
Liu, Y., Fan, B., Meng, G., Lu, J., Xiang, S., & Pan, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00534 · Cited by 288
3D Recurrent Neural Networks with Context Fusion for Point Cloud Semantic Segmentation
Ye, X., Li, J., Huang, H., Du, L., & Zhang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_25 · Cited by 287
Engel, N., Belagiannis, V., & Dietmayer, K. (2021) · IEEE Access · doi:10.1109/access.2021.3116304 · Cited by 284
Zhou, C., & Ling, Q. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3336053 · Cited by 284
Improving 3D Object Detection with Channel-wise Transformer
Shenga, H., Cai, S., Liu, Y., Deng, B., Huang, J., Hua, X.-S., & Zhao, M.-J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00274 · Cited by 282
Methods and datasets on semantic segmentation: A review
Yu, H., Yang, Z., Tan, L., Wang, Y., Sun, W., Sun, M., & Tang, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.037 · Cited by 281
BSP-Net: Generating Compact Meshes via Binary Space Partitioning
Chen, Z., Tagliasacchi, A., & Zhang, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00012 · Cited by 279
Associatively Segmenting Instances and Semantics in Point Clouds
Wang, X., Liu, S., Shen, X., Shen, C., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00422 · Cited by 278
Self-Supervised Pretraining of 3D Features on any Point-Cloud
Zhang, Z., Girdhar, R., Joulin, A., & Misra, I. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01009 · Cited by 278
Geometric Back-Projection Network for Point Cloud Classification
Qiu, S., Anwar, S., & Barnes, N. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3074240 · Cited by 274
GIFT: A Real-Time and Scalable 3D Shape Search Engine
Bai, S., Bai, X., Zhou, Z., Zhang, Z., & Latecki, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.543 · Cited by 271
Surface-Electromyography-Based Gesture Recognition by Multi-View Deep Learning
Wei, W., Dai, Q., Wong, Y., Hu, Y., Kankanhalli, M., & Geng, W. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899222 · Cited by 261
A Multi-View Deep Learning Framework for EEG Seizure Detection
Yuan, Y., Xun, G., Jia, K., & Zhang, A. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2871678 · Cited by 258
TI-POOLING: Transformation-Invariant Pooling for Feature Learning in Convolutional Neural Networks
Laptev, D., Savinov, N., Buhmann, J. M., & Pollefeys, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.38 · Cited by 255
VConv-DAE: Deep Volumetric Shape Learning Without Object Labels
Sharma, A., Grau, O., & Fritz, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_20 · Cited by 254
Multi-input Cardiac Image Super-Resolution Using Convolutional Neural Networks
Oktay, O., Bai, W., Lee, M., Guerrero, R., Kamnitsas, K., Caballero, J., de Marvao, A., Cook, S., O’Regan, D., & Rueckert, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46726-9_29 · Cited by 246
Task-Oriented Communication for Multidevice Cooperative Edge Inference
Shao, J., Mao, Y., & Zhang, J. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3191118 · Cited by 209
A dataset for developing and benchmarking active vision
Ammirato, P., Poirson, P., Park, E., Kosecka, J., & Berg, A. C. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989164 · Cited by 187
Deep learning in robotics: survey on model structures and training strategies
Karoly, A. I., Galambos, P., Kuti, J., & Rudas, I. J. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3018325 · Cited by 146
A novel weakly-supervised approach for RGB-D-based nuclear waste object detection
Sun, L., Zhao, C., Yan, Z., Liu, P., Duckett, T., & Stolkin, R. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2888815 · Cited by 119
IntrA: 3D Intracranial Aneurysm Dataset for Deep Learning
Yang, X., Xia, D., Kin, T., & Igarashi, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00273 · Cited by 99
Recent Advancements in Learning Algorithms for Point Clouds: An Updated Overview
Camuffo, E., Mari, D., & Milani, S. (2022) · Sensors · doi:10.3390/s22041357 · Cited by 73
Learning Semantic Deformation Flows with 3D Convolutional Networks
Yumer, M. E., & Mitra, N. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_18 · Cited by 60
Rizzoli, G., Barbato, F., & Zanuttigh, P. (2022) · Technologies · doi:10.3390/technologies10040090 · Cited by 58
ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding
Guo, Z., Tang, Y., Zhang, R., Wang, D., Wang, Z., Zhao, B., & Li, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01410 · Cited by 44
Learning Weight Uncertainty with Stochastic Gradient MCMC for Shape Classification
Li, C., Stevens, A., Chen, C., Pu, Y., Gan, Z., & Carin, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.611 · Cited by 39
“(ii) The second approach is to project the 3D model into multiple 2D depth-view-images, and perform 2D convolutions on each view [66].”
BackgroundMethodInfluentialIntelligent Systems for Muscle Tracking: A Review on Sensor‐Algorithm Synergy
Putcha, A., Nguyen, T., Smith, R., Choffin, R., & Bai, W. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202200351 · Cited by 10
Zhu, M., Zecchin, M., Park, S., Guo, C., Feng, C., Popovski, P., & Simeone, O. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3549222 · Cited by 6
ZUMA: Training-Free Zero-Shot Unified Multimodal Anomaly Detection
Ma, Y., Liu, M., Jiang, S., Zhou, J., Bian, Y., Wang, X., & Wang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3658856 · Cited by 4
Metadata
- Authors
- Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 945-953
- OpenAlex
- W1644641054
- Cited by
- 3,480
- References
- 40
- FWCI
- 273.69
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.