The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Efficient grasping from RGBD images: Learning using a new rectangle representation
Abstract
Given an image and an aligned depth map of an object, our goal is to estimate the full 7-dimensional gripper configuration—its 3D location, 3D orientation and the gripper opening width. Recently, learning algorithms have been successfully applied to grasp novel objects—ones not seen by the robot before. While these approaches use low-dimensional representations such as a ‘grasping point’ or a ‘pair of points’ that are perhaps easier to learn, they only partly represent the gripper configuration and hence are sub-optimal. We propose to learn a new ‘grasping rectangle’ representation: an oriented rectangle in the image plane. It takes into account the location, the orientation as well as the gripper opening width. However, inference with such a representation is computationally expensive. In this work, we present a two step process in which the first step prunes the search space efficiently using certain features that are fast to compute. For the remaining few cases, the second step uses advanced features to accurately select a good grasp. In our extensive experiments, we show that our robot successfully uses our algorithm to pick up a variety of novel objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
(2016) · Time Series with Mixed Spectra · doi:10.1201/b15154-8 · Cited by 2,739
Seber, G. A. F., & Lee, A. J. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/9780471722199 · Cited by 1,135
Robotic grasping and contact: a review
Bicchi, A., & Kumar, V. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844081 · Cited by 1,069
Miller, A. T., & Allen, P. K. (2004) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2004.1371616 · Cited by 1,023
(2005) · Cited by 981
Robotic Grasping of Novel Objects using Vision
Saxena, A., Driemeyer, J., & Ng, A. Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364907087172 · Cited by 923
Self-citationRGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
Automatic grasp planning using shape primitives
Miller, A. T., Knoop, S., Christensen, H. I., & Allen, P. K. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241860 · Cited by 705
Sharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
Robot Grasp Synthesis Algorithms: A Survey
Shimoga, K. B. (1996) · The International Journal of Robotics Research · doi:10.1177/027836499601500302 · Cited by 666
Probabilistic modeling of local appearance and spatial relationships for object recognition
Schneiderman, H., & Kanade, T. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698586 · Cited by 358
Goldfeder, C., Ciocarlie, M., Dang, H., & Allen, P. K. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152709 · Cited by 309
Programming pearls: algorithm design techniques
Bentley, J. (1984) · Communications of the ACM · doi:10.1145/358234.381162 · Cited by 242
An SVM learning approach to robotic grasping
Pelossof, R., Miller, A., Allen, P., & Jebara, T. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1308797 · Cited by 216
Contact-reactive grasping of objects with partial shape information
Hsiao, K., Chitta, S., Ciocarlie, M., & Jones, E. G. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5649494 · Cited by 201
Reactive grasping using optical proximity sensors
Hsiao, K., Nangeroni, P., Huber, M., Saxena, A., & Ng, A. Y. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152849 · Cited by 162
Self-citationRobotic Grasping of Novel Objects
Saxena, A., Driemeyer, J., Kearns, J., & Ng, A. Y. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0156 · Cited by 155
Self-citationHsiao, K., Kaelbling, L. P., & Lozano‐Pérez, T. (2007) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2007.364201 · Cited by 150
Learning grasp strategies with partial shape information
Saxena, A., Wong, L. L. S., & Ng, A. Y. (2008) · Cited by 149
Self-citationGrasping novel objects with depth segmentation
Rao, D., Le, Q. V., Phoka, T., Quigley, M., Sudsang, A., & Ng, A. Y. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5650493 · Cited by 125
Learning to grasp objects with multiple contact points
Le, Q. V., Kamm, D., Kara, A. F., & Ng, A. Y. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509508 · Cited by 119
On Computing Two-Finger Force-Closure Grasps of Curved 2D Objects
Ponce, J., Stam, D., & Faverjon, B. (1993) · The International Journal of Robotics Research · doi:10.1177/027836499301200305 · Cited by 118
Klingbeil, E., Saxena, A., & Ng, A. Y. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5649847 · Cited by 111
Self-citationLearning 3-D object orientation from images
Saxena, A., Driemeyer, J., & Ng, A. (2009) · IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152855 · Cited by 102
Self-citationHigh-accuracy 3D sensing for mobile manipulation: Improving object detection and door opening
Quigley, M., Batra, S., Gould, S. J., Klingbeil, E., Le, Q. V., Wellman, A., & Ng, A. Y. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152750 · Cited by 89
Imitation Learning of Whole-Body Grasps
Hsiao, K., & Lozano‐Pérez, T. (2006) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2006.282366 · Cited by 88
Manipulation of unmodeled objects using intelligent grasping schemes
Bowers, D. L., & Lumia, R. (2003) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2003.812689 · Cited by 55
Vision-based computation of three-finger grasps on unknown planar objects
Morales, A., Sanz, P. J., & del Pobil, A. P. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1044002 · Cited by 45
Learning of demonstrated grasping skills by stereoscopic tracking of human head configuration
Hüser, M., Baier, T., & Zhang, J. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2006.1642124 · Cited by 36
Learning Visual Features to Predict Hand Orientations
Piater, J. (2002) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 21
Monocular depth perception and robotic grasping of novel objects
Ng, A. Y., & Saxena, A. (2009) · Cited by 19
Self-citation
Cited by
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Self-citationSupersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Real-time grasp detection using convolutional neural networks
Redmon, J., & Angelova, A. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139361 · Cited by 893
GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping
Fang, H.-S., Wang, C., Gou, M., & Lu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01146 · Cited by 683
Learning human activities and object affordances from RGB-D videos
Koppula, H. S., Gupta, R., & Saxena, A. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913478446 · Cited by 683
Self-citation
Metadata
- Authors
- Jiang, Y., Moseson, S., & Saxena, A.
- Venue
- 2011 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2011-05
- Pages
- 3304-3311
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2123435073
- Cited by
- 657
- References
- 33
- FWCI
- 18.78
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.