The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views
Open accessAbstract
Object viewpoint estimation from 2D images is an essential task in computer vision. However, two issues hinder its progress: scarcity of training data with viewpoint annotations, and a lack of powerful features. Inspired by the growing availability of 3D models, we propose a framework to address both issues by combining render-based image synthesis and CNNs (Convolutional Neural Networks). We believe that 3D models have the potential in generating a large number of images of high variation, which can be well exploited by deep CNN with a high learning capacity. Towards this goal, we propose a scalable and overfit-resistant image synthesis pipeline, together with a novel CNN specifically tailored for the viewpoint estimation task. Experimentally, we show that the viewpoint estimation from our pipeline can significantly outperform state-of-the-art methods on PASCAL 3D+ benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
(2008) · Journal of Machine Learning Research · Cited by 33,051
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
Free-form deformation of solid geometric models
Sederberg, T. W., & Parry, S. R. (1986) · ACM SIGGRAPH Computer Graphics · doi:10.1145/15886.15903 · Cited by 2,577
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Self-citationShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
Self-citationA Bayesian computer vision system for modeling human interactions
Oliver, N. M., Rosario, B., & Pentland, A. P. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868684 · Cited by 1,578
As-Rigid-As-Possible Surface Modeling
Sorkine‐Hornung, O., & Alexa, M. (2007) · doi:10.2312/sgp/sgp07/109-116 · Cited by 778
Beyond PASCAL: A benchmark for 3D object detection in the wild
Xiang, Y., Mottaghi, R., & Savarese, S. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836101 · Cited by 727
Free-form deformation of solid geometric models
Sederberg, T. W., & Parry, S. R. (1986) · Proceedings of the 13th annual conference on Computer graphics and interactive techniques · doi:10.1145/15922.15903 · Cited by 698
Seeing 3D Chairs: Exemplar Part-Based 2D-3D Alignment Using a Large Dataset of CAD Models
Aubry, M., Maturana, D., Efros, A. A., Russell, B. C., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.487 · Cited by 473
Description and recognition of curved objects☆
Nevatia, R., & Binford, T. O. (1977) · Artificial Intelligence · doi:10.1016/0004-3702(77)90006-6 · Cited by 446
High speed obstacle avoidance using monocular vision and reinforcement learning
Michels, J., Saxena, A., & Ng, A. Y. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102426 · Cited by 394
3D generic object categorization, localization and pose estimation
Savarese, S., & Fei-Fei, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408987 · Cited by 384
Tulsiani, S., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298758 · Cited by 346
The singularities of the visual mapping
Koenderink, J. J., & van Doorn, A. J. (1976) · Biological Cybernetics · doi:10.1007/bf00365595 · Cited by 300
Parsing IKEA Objects: Fine Pose Estimation
Lim, J. J., Pirsiavash, H., & Torralba, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.372 · Cited by 249
SoftPOSIT: Simultaneous Pose and Correspondence Determination
David, P., DeMenthon, D., Duraiswami, R., & Samet, H. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000025800.10423.1f · Cited by 236
Multi-view object class detection with a 3D geometric model
Liebelt, J., & Schmid, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539836 · Cited by 183
Joint embeddings of shapes and images via CNN image purification
Li, Y., Su, H., Qi, C. R., Fish, N., Cohen-Or, D., & Guibas, L. J. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818071 · Cited by 174
Self-citationStructure-aware shape processing
Mitra, N., Wand, M., Zhang, H. (., Cohen-Or, D., Kim, V., & Huang, Q.-X. (2013) · SIGGRAPH Asia 2013 Courses · doi:10.1145/2542266.2542267 · Cited by 162
Back to the Future: Learning Shape Models from 3D CAD Data
Stark, M. M., Goesele, M., & Schiele, B. (2010) · British Machine Vision Conference (BMVC) · doi:10.5244/c.24.106 · Cited by 151
Su, H., Sun, M., Fei-Fei, L., & Savarese, S. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459168 · Cited by 144
Self-citationA Similarity-Based Aspect-Graph Approach to 3D Object Recognition
Cyr, C. M., & Kimia, B. B. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013088.59081.4c · Cited by 114
Aspect graphs: An introduction and survey of recent results
Bowyer, K. W., & Dyer, C. R. (1990) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.1850020407 · Cited by 106
3D ShapeNets for 2.5D Object Recognition and Next-Best-View PredictionPreprint
Wu, Z., Song, S., Khosla, A., Tang, X., & Xiao, J. (2014) · arXiv (Cornell University) · Cited by 97
3D2PM – 3D Deformable Part Models
Pepik, B., Gehler, P., Stark, M. M., & Schiele, B. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33783-3_26 · Cited by 80
FPM: Fine Pose Parts-Based Model with 3D CAD Models
Lim, J. J., Khosla, A., & Torralba, A. B. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_31 · Cited by 77
A symmetric patch-based correspondence model for occlusion handling
Deng, Y. P., Yang, Q., Lin, X., & Tang, X. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.23 · Cited by 70
Inferring 3D Object Pose in RGB-D ImagesPreprint
Gupta, S., Arbeláez, P., Girshick, R., & Malik, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04652 · Cited by 33
Convolutional Neural Networks for joint object detection and pose estimation: A comparative studyPreprint
Massa, F., Aubry, M., & Marlet, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7190 · Cited by 20
Cited by
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
“More recently, 3D models have been used to augment training data to aid transferring deep neural networks between datasets and prevent over-fitting on small datasets for tasks like viewpoint estimation [40] and object detection [42], [29].”
MethodPoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
3D Bounding Box Estimation Using Deep Learning and Geometry
Mousavian, A., Anguelov, D., Flynn, J., & Kosecka, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.597 · Cited by 1,129
PVNet: Pixel-Wise Voting Network for 6DoF Pose Estimation
Peng, S., Liu, Y., Huang, Q., Zhou, X., & Bao, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00469 · Cited by 1,061
Learning from Synthetic Humans
Varol, G., Romero, J., Martin, X., Mahmood, N., Black, M. J., Laptev, I., & Schmid, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.492 · Cited by 908
Metadata
- Authors
- Su, H., Qi, C. R., Li, Y., & Guibas, L. J.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 2686-2694
- OpenAlex
- W1591870335
- Cited by
- 680
- References
- 35
- FWCI
- 32.84
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.