The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Efficient grasping from RGBD images: Learning using a new rectangle representation
Abstract
Given an image and an aligned depth map of an object, our goal is to estimate the full 7-dimensional gripper configuration—its 3D location, 3D orientation and the gripper opening width. Recently, learning algorithms have been successfully applied to grasp novel objects—ones not seen by the robot before. While these approaches use low-dimensional representations such as a ‘grasping point’ or a ‘pair of points’ that are perhaps easier to learn, they only partly represent the gripper configuration and hence are sub-optimal. We propose to learn a new ‘grasping rectangle’ representation: an oriented rectangle in the image plane. It takes into account the location, the orientation as well as the gripper opening width. However, inference with such a representation is computationally expensive. In this work, we present a two step process in which the first step prunes the search space efficiently using certain features that are fast to compute. For the remaining few cases, the second step uses advanced features to accurately select a good grasp. In our extensive experiments, we show that our robot successfully uses our algorithm to pick up a variety of novel objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
(2016) · Time Series with Mixed Spectra · doi:10.1201/b15154-8 · Cited by 2,739
Seber, G. A. F., & Lee, A. J. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/9780471722199 · Cited by 1,135
Robotic grasping and contact: a review
Bicchi, A., & Kumar, V. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844081 · Cited by 1,069
Miller, A. T., & Allen, P. K. (2004) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2004.1371616 · Cited by 1,023
(2005) · Cited by 981
Robotic Grasping of Novel Objects using Vision
Saxena, A., Driemeyer, J., & Ng, A. Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364907087172 · Cited by 923
Self-citationRGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
Automatic grasp planning using shape primitives
Miller, A. T., Knoop, S., Christensen, H. I., & Allen, P. K. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241860 · Cited by 705
Cited by
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Self-citationSupersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Real-time grasp detection using convolutional neural networks
Redmon, J., & Angelova, A. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139361 · Cited by 893
GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping
Fang, H.-S., Wang, C., Gou, M., & Lu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01146 · Cited by 683
Learning human activities and object affordances from RGB-D videos
Koppula, H. S., Gupta, R., & Saxena, A. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913478446 · Cited by 683
Self-citationClosing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach
Morrison, D., Leitner, J., & Corke, P. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.021 · Cited by 630
6-DOF GraspNet: Variational Grasp Generation for Object Manipulation
Mousavian, A., Eppner, C., & Fox, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00299 · Cited by 571
Robotic grasp detection using deep convolutional neural networks
Kumra, S., & Kanan, C. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202237 · Cited by 536
Learning robust, real-time, reactive robotic grasping
Morrison, D., Corke, P., & Leitner, J. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919859066 · Cited by 489
Du, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
Real-World Multiobject, Multigrasp Detection
Chu, F.-J., Xu, R., & Vela, P. A. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852777 · Cited by 453
Antipodal Robotic Grasping using Generative Residual Convolutional Neural Network
Kumra, S., Joshi, S., & Sahin, F. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340777 · Cited by 437
Jacquard: A Large Scale Dataset for Robotic Grasp Detection
Depierre, A., Dellandrea, E., & Chen, L. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593950 · Cited by 372
A Survey on Learning-Based Robotic Grasping
Kleeberger, K., Bormann, R., Kraus, W., & Huber, M. F. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00021-6 · Cited by 290
AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains
Fang, H.-S., Wang, C., Fang, H., Gou, M., Liu, J., Yan, H., Liu, W., Xie, Y., & Lu, C. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3281153 · Cited by 276
Deep Learning Approaches to Grasp Synthesis: A Review
Newbury, R., Gu, M., Chumbley, L., Mousavian, A., Eppner, C., Leitner, J., Bohg, J., Morales, A., Asfour, T., Kragic, D., et al. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3280597 · Cited by 255
Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration 0
O’Neill, A., Rehman, A., Maddukuri, A., Gupta, A., Padalkar, A., Lee, A., Pooley, A., Gupta, A., Mandlekar, A., Jain, A., et al. (2024) · 2024 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra57147.2024.10611477 · Cited by 210
Deep Learning for Detecting Robotic Grasps
Lenz, I., Lee, H., & Saxena, A. (2013) · Robotics: Science and Systems IX · doi:10.15607/rss.2013.ix.012 · Cited by 126
Self-citationContactGrasp: Functional Multi-finger Grasp Synthesis from Contact
Brahmbhatt, S., Handa, A., Hays, J., & Fox, D. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967960 · Cited by 125
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
Jiang, Z., Zhu, Y., Svetlik, M., Fang, K., & Zhu, Y. (2021) · Robotics: Science and Systems XVII · doi:10.15607/rss.2021.xvii.024 · Cited by 122
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
Jiang, Z., Zhu, Y., Svetlik, M., Fang, K., & Zhu, Y. (2021) · arXiv · doi:10.48550/arxiv.2104.01542 · Cited by 122
“Supervision from grasp, in turn, produce better 3D reconstruction in graspable regions. end-to-end on large-scale grasping datasets, either through manual labeling [19] or self-exploration [20, 43].”
BackgroundFujita, M., Domae, Y., Noda, A., Garcia Ricardez, G. A., Nagatani, T., Zeng, A., Song, S., Rodriguez, A., Causo, A., Chen, I. M., et al. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1698463 · Cited by 78
“proposed a method [17] which searches in an RGB image for a pose that is easy for a two-finger gripper to grasp and they were the first to make it practical [18] by using deep learning.”
MethodTangled: Learning to untangle ropes with RGB-D perception
Lui, W. H., & Saxena, A. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696448 · Cited by 71
Self-citationLanguage-driven Grasp Detection
Vuong, A. D., Vu, M. N., Huang, B., Nguyen, N., Le, H., Vo, T., & Nguyen, A. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01695 · Cited by 39
Metadata
- Authors
- Jiang, Y., Moseson, S., & Saxena, A.
- Venue
- 2011 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2011-05
- Pages
- 3304-3311
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2123435073
- Cited by
- 657
- References
- 33
- FWCI
- 18.78
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.