The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Real-Time Seamless Single Shot 6D Object Pose Prediction
Open accessAbstract
We propose a single-shot approach for simultaneously detecting an object in an RGB image and predicting its 6D pose without requiring multiple stages or having to examine multiple hypotheses. Unlike a recently proposed single-shot technique for this task [10] that only predicts an approximate 6D pose that must then be refined, ours is accurate enough not to require additional post-processing. As a result, it is much faster - 50 fps on a Titan X (Pascal) GPU - and more suitable for real-time processing. The key component of our method is a new CNN architecture inspired by [27, 28] that directly predicts the 2D image locations of the projected vertices of the object's 3D bounding box. The object's 6D pose is then estimated using a PnP algorithm. For single object and multiple object pose estimation on the LINEMOD and OCCLUSION datasets, our approach substantially outperforms other recent CNN-based approaches [10, 25] when they are all used without postprocessing. During post-processing, a pose refinement step can be used to boost the accuracy of these two methods, but at 10 fps or less, they are much slower than our method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
(2016) · Cited by 31,590
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Comparing images using the Hausdorff distance
Huttenlocher, D. P., Klanderman, G. A., & Rucklidge, W. J. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.232073 · Cited by 4,545
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Self-citationPoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
A large-scale hierarchical multi-view RGB-D object dataset
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980382 · Cited by 1,316
Hinterstoisser, S., Lepetit, V., Ilic, S., Holzer, S., Bradski, G., Konolige, K., & Navab, N. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37331-2_42 · Cited by 1,161
SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again
Kehl, W., Manhardt, F., Tombari, F., Ilic, S., & Navab, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.169 · Cited by 1,047
Rad, M., & Lepetit, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.413 · Cited by 843
Fitting parameterized three-dimensional models to images
Lowe, D. G. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.134043 · Cited by 837
Learning 6D Object Pose Estimation Using 3D Object Coordinates
Brachmann, E., Krull, A., Michel, F., Gumhold, S., Shotton, J., & Rother, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_35 · Cited by 782
Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views
Su, H., Qi, C. R., Li, Y., & Guibas, L. J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.308 · Cited by 680
Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes
Hinterstoisser, S., Holzer, S., Cagniart, C., Ilic, S., Konolige, K., Navab, N., & Lepetit, V. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126326 · Cited by 643
Uncertainty-Driven 6D Pose Estimation of Objects and Scenes from a Single RGB Image
Brachmann, E., Michel, F., Krull, A., Yang, M. Y., Gumhold, S., & Rother, C. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.366 · Cited by 530
Monocular Model-Based 3D Tracking of Rigid Objects: A Survey
Lepetit, V., & Fua, P. (2005) · now publishers, Inc. eBooks · doi:10.1561/9781933019536 · Cited by 526
Self-citationMonocular model-based 3D tracking of rigid objects: a survey
Lepetit, V., & Fua, P. (2005) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000001 · Cited by 484
Self-citationThe MOPED framework: Object recognition and pose estimation for manipulation
Collet, A., Martinez, M., & Srinivasa, S. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911401765 · Cited by 421
Pose tracking from natural features on mobile phones
Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., & Schmalstieg, D. (2008) · 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2008.4637338 · Cited by 420
Rothganger, F., Lazebnik, S., Schmid, C., & Ponce, J. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-3674-1 · Cited by 416
Tulsiani, S., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298758 · Cited by 346
Stable real-time 3D tracking using online and offline information
Vacchetti, L., Lepetit, V., & Fua, P. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.92 · Cited by 328
Self-citationDeep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
Kehl, W., Milletari, F., Tombari, F., Ilic, S., & Navab, N. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_13 · Cited by 283
Single image 3D object detection and pose estimation for grasping
Zhu, M., Derpanis, K. G., Yang, Y., Brahmbhatt, S., Zhang, M., Phillips, C., Lecce, M., & Daniilidis, K. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907430 · Cited by 218
3D Pose Regression Using Convolutional Neural Networks
Mahendran, S., Ali, H., & Vidal, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.73 · Cited by 210
Fast directional chamfer matching
Liu, M.-Y., Tuzel, O., Veeraraghavan, A., & Chellappa, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539837 · Cited by 206
Discriminatively Trained Templates for 3D Object Detection: A Real Time Scalable Approach
Rios-Cabrera, R., & Tuytelaars, T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.256 · Cited by 169
Global Hypothesis Generation for 6D Object Pose Estimation
Michel, F., Kirillov, A., Brachmann, E., Krull, A., Gumhold, S., Savchynskyy, B., & Rother, C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.20 · Cited by 126
Fast Single Shot Detection and Pose Estimation
Poirson, P., Ammirato, P., Fu, C.-Y., Liu, W., Košecká, J., & Berg, A. C. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.78 · Cited by 113
A Scalable Tree-Based Approach for Joint Object and Pose Recognition
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7986 · Cited by 93
3D textureless object detection and tracking: An edge-based approach
Choi, C., & Christensen, H. I. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386065 · Cited by 83
Rad, M., & Lepetit, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10896 · Cited by 82
Multi-view 6D Object Pose Estimation and Camera Motion Planning Using RGBD Images
Sock, J., Kasaei, S. H., Lopes, L. S., & Kim, T.-K. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.260 · Cited by 60
RGB-D object pose estimation in unstructured environments
Choi, C., & Christensen, H. I. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.09.020 · Cited by 58
Car make and model recognition using 3D curve alignment
Hsiao, E., Sinha, S. N., Ramnath, K., Baker, S., Zitnick, L., & Szeliski, R. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836126 · Cited by 54
Self-citationCar make and model recognition using 3D curve alignment
Ramnath, K., Sinha, S. N., Szeliski, R., & Hsiao, E. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836087 · Cited by 50
Self-citationA dynamic programming approach for fast and robust object pose recognition from range images
Zach, C., Peñate-Sánchez, A., & Pham, M.-T. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298615 · Cited by 43
Robustly Aligning a Shape Model and Its Application to Car Alignment of Unknown Pose
Li, Y., Gu, L., & Takeo Kanade, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.40 · Cited by 43
Combined Holistic and Local Patches for Recovering 6D Object Pose
Cao, Q., & Zhang, H. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.259 · Cited by 19
Cited by
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
Wang, C., Xu, D., Zhu, Y., Martín-Martín, R., Lu, C., Fei-Fei, L., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00346 · Cited by 1,154
PVNet: Pixel-Wise Voting Network for 6DoF Pose Estimation
Peng, S., Liu, Y., Huang, Q., Zhou, X., & Bao, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00469 · Cited by 1,061
PointNetLK: Robust & Efficient Point Cloud Registration Using PointNet
Aoki, Y., Goforth, H., Srivatsan, R. A., & Lucey, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00733 · Cited by 896
Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation
Wang, H., Sridhar, S., Huang, J., Valentin, J., Song, S., & Guibas, L. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00275 · Cited by 757
Metadata
- Authors
- Tekin, B., Sinha, S. N., & Fua, P.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 292-301
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2768879211
- Cited by
- 900
- References
- 44
- FWCI
- 33.00
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.