The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
DexYCB: A Benchmark for Capturing Hand Grasping of Objects
Open accessAbstract
We introduce DexYCB, a new dataset for capturing hand grasping of objects. We first compare DexYCB with a related one through cross-dataset evaluation. We then present a thorough benchmark of state-of-the-art approaches on three relevant tasks: 2D object and keypoint detection, 6D object pose estimation, and 3D hand pose estimation. Finally, we evaluate a new robotics-relevant task: generating safe robot grasps in human-to-robot object handover.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Deep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Xiang, Y., Schmidt, T., Narayanan, V., & Fox, D. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.019 · Cited by 2,139
Self-citationDenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
Wang, C., Xu, D., Zhu, Y., Martín-Martín, R., Lu, C., Fei-Fei, L., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00346 · Cited by 1,154
Hand Keypoint Detection in Single Images Using Multiview Bootstrapping
Simon, T., Joo, H., Matthews, I., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.494 · Cited by 1,119
PVNet: Pixel-Wise Voting Network for 6DoF Pose Estimation
Peng, S., Liu, Y., Huang, Q., Zhou, X., & Bao, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00469 · Cited by 1,061
Romero (2017) · doi:10.1145/3130800.3130883 · Cited by 1,056
Real-Time Seamless Single Shot 6D Object Pose Prediction
Tekin, B., Sinha, S. N., & Fua, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00038 · Cited by 900
Learning to Estimate 3D Hand Pose from Single RGB Images
Zimmermann, C., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.525 · Cited by 761
Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation
Wang, H., Sridhar, S., Huang, J., Valentin, J., Song, S., & Guibas, L. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00275 · Cited by 757
CosyPose: Consistent Multi-view Multi-object 6D Pose Estimation
Labbé, Y., Carpentier, J., Aubry, M., & Šivic, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_34 · Cited by 597
DeepIM: Deep Iterative Matching for 6D Pose Estimation
Li, Y., Wang, G., Ji, X., Xiang, Y., & Fox, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_42 · Cited by 576
Self-citationImplicit 3D Orientation Learning for 6D Object Detection from RGB Images
Sundermeyer, M., Marton, Z.-C., Durner, M., Brucker, M., & Triebel, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_43 · Cited by 564
GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB
Mueller, F., Bernard, F., Sotnychenko, O., Mehta, D., Sridhar, S., Casas, D., & Theobalt, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00013 · Cited by 521
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations
Garcia-Hernando, G., Yuan, S., Baek, S., & Kim, T.-K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00050 · Cited by 519
Learning Joint Reconstruction of Hands and Manipulated Objects
Hasson, Y., Varol, G., Tzionas, D., Kalevatykh, I., Black, M. J., Laptev, I., & Schmid, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01208 · Cited by 513
BOP: Benchmark for 6D Object Pose Estimation
Hodaň, T., Michel, F., Brachmann, E., Kehl, W., Buch, A. G., Kraft, D., Drost, B., Vidal, J., Ihrke, S., Zabulis, X., et al. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_2 · Cited by 470
3D Hand Shape and Pose Estimation From a Single RGB Image
Ge, L., Ren, Z., Li, Y., Xue, Z., Wang, Y., Cai, J., & Yuan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01109 · Cited by 458
Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimation
Park, K., Patten, T., & Vincze, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00776 · Cited by 455
Vondrick, C., Patterson, D., & Ramanan, D. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0564-1 · Cited by 448
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape From Single RGB Images
Zimmermann, C., Ceylan, D., Yang, J., Russell, B., Argus, M. J., & Brox, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00090 · Cited by 445
CosyPose: Consistent multi-view multi-object 6D pose estimationPreprint
Labbé, Y., Carpentier, J., Aubry, M., & Šivic, J. (2020) · arXiv (Cornell University) · Cited by 434
HOnnotate: A Method for 3D Annotation of Hand and Object Poses
Hampali, S., Rad, M., Oberweger, M., & Lepetit, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00326 · Cited by 422
Hand Pose Estimation via Latent 2.5D Heatmap Regression
Iqbal, U., Molchanov, P., Breuel, T., Gall, J., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_8 · Cited by 316
Self-citationMoon, G., Yu, S.-I., Wen, H., Shiratori, T., & Lee, K. M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_33 · Cited by 293
H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions
Tekin, B., Bogo, F., & Pollefeys, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00464 · Cited by 269
BOP Challenge 2020 on 6D Object Localization
Hodaň, T., Sundermeyer, M., Drost, B., Labbé, Y., Brachmann, E., Michel, F., Rother, C., & Matas, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-66096-3_39 · Cited by 268
Understanding Human Hands in Contact at Internet Scale
Shan, D., Geng, J., Shu, M., & Fouhey, D. F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00989 · Cited by 256
Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects
Tremblay, J., To, T., Sundaralingam, B., Yu, X., Fox, D., & Birchfield, S. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10790 · Cited by 244
Self-citationBigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis
Yuan, S., Ye, Q., Stenger, B., Jain, S., & Kim, T.-K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.279 · Cited by 243
Real-Time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor
Mueller, F., Mehta, D., Sotnychenko, O., Sridhar, S., Casas, D., & Theobalt, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.131 · Cited by 242
Real-Time Joint Tracking of a Hand Manipulating an Object from RGB-D Input
Sridhar, S., Mueller, F., Zollhöfer, M., Casas, D., Oulasvirta, A., & Theobalt, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_19 · Cited by 240
HOPE-Net: A Graph-Based Model for Hand-Object Pose Estimation
Doosti, B., Naha, S., Mirbagheri, M., & Crandall, D. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00664 · Cited by 215
DexPilot: Vision-Based Teleoperation of Dexterous Robotic Hand-Arm System
Handa, A., Van Wyk, K., Yang, W., Liang, J., Chao, Y.-W., Wan, Q., Birchfield, S., Ratliff, N., & Fox, D. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197124 · Cited by 209
Self-citationWeakly Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Spurr, A., Iqbal, U., Molchanov, P. A., Hilliges, O., & Kautz, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_13 · Cited by 201
Self-citationContactPose: A Dataset of Grasps with Object Contact and Hand Pose
Brahmbhatt, S., Tang, C., Twigg, C. D., Kemp, C. C., & Hays, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58601-0_22 · Cited by 200
A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation From a Single Depth Image
Xiong, F., Zhang, B., Xiao, Y., Cao, Z., Yu, T., Zhou, J. T., & Yuan, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00088 · Cited by 189
Leveraging Photometric Consistency Over Time for Sparsely Supervised Hand-Object Reconstruction
Hasson, Y., Tekin, B., Bogo, F., Laptev, I., Pollefeys, M., & Schmid, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00065 · Cited by 185
GanHand: Predicting Human Grasp Affordances in Multi-Object Scenes
Corona, E., Pumarola, A., Alenya, G., Moreno-Noguer, F., & Rogez, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00508 · Cited by 171
Real-time pose and shape reconstruction of two interacting hands with a single depth camera
Mueller, F., Davis, M., Bernard, F., Sotnychenko, O., Verschoor, M., Otaduy, M. A., Casas, D., & Theobalt, C. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322958 · Cited by 169
Interactive hand pose estimation using a stretch-sensing soft glove
Glauser, O., Wu, S., Panozzo, D., Hilliges, O., & Sorkine-Hornung, O. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322957 · Cited by 169
HUMBI: A Large Multiview Dataset of Human Body Expressions
Yu, Z., Yoon, J. S., Lee, I. K., Venkatesh, P., Park, J., Yu, J., & Park, H. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00306 · Cited by 119
BOP: Benchmark for 6D Object Pose EstimationPreprint
Hodaň, T., Michel, F., Brachmann, E., Kehl, W., Buch, A. G., Kraft, D., Drost, B., Vidal, J., Ihrke, S., Zabulis, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.08319 · Cited by 104
SOLOv2: Dynamic, Faster and Stronger.Preprint
Wang, X., Zhang, R., Kong, T., Li, L., & Shen, C. (2020) · arXiv (Cornell University) · Cited by 77
Human Grasp Classification for Reactive Human-to-Robot Handovers
Yang, W., Paxton, C., Çakmak, M., & Fox, D. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341004 · Cited by 75
Self-citationEppner, C., Mousavian, A., & Fox, D. (2022) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-95459-8_55 · Cited by 74
Self-citationArmagan, A., Garcia-Hernando, G., Baek, S., Hampali, S., Rad, M., Zhang, Z., Xie, S., Chen, M., Zhang, B., Xiong, F., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_6 · Cited by 63
Self-citationPoseRBPF: A Rao-Blackwellized Particle Filter for6D Object Pose Estimation
Deng, X., Mousavian, A., Yu, X., Xia, F., Bretl, T. W., & Fox, D. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.049 · Cited by 60
Self-citation
Cited by
(2023) · doi:10.1109/iros55552.2023.10341379 · Cited by 48
“Many recent methods [23], [36], [50], [51], [53], [11], [1] are mainly based on deep learning.”
Method
Metadata
- Authors
- Chao, Y.-W., Yang, W., Xiang, Y., Molchanov, P., Handa, A., Tremblay, J., Narang, Y. S., Van Wyk, K., Iqbal, U., Birchfield, S., Kautz, J., & Fox, D.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 9040-9049
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3180172155
- Cited by
- 285
- References
- 49
- FWCI
- 62.44
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.