Data-Driven Grasp Synthesis—A Survey
Open accessThe DOI matches its Crossref record; 115 of the 119 references it cites were found in a registry or an index.
Abstract
We review the work on data-driven grasp synthesis and the methodologies for sampling and ranking candidate grasps. We divide the approaches into three groups based on whether they synthesize grasps for known, familiar, or unknown objects. This structure allows us to identify common object representations and perceptual processes that facilitate the employed data-driven grasp synthesis technique. In the case of known objects, we concentrate on the approaches that are based on object recognition and pose estimation. In the case of familiar objects, the techniques use some form of a similarity matching to a set of previously encountered objects. Finally, for the approaches dealing with unknown objects, the core part is the extraction of specific features that are indicative of good grasps. Our survey provides an overview of the different methodologies and discusses open problems in the area of robot grasping. We also draw a parallel to the classical approaches that rely on analytic formulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most of the existing state-of-the-art in grasping are oneshot , i.e. , they perceive once and plan grasps assuming the object is stationary; the arm is then commanded to the grasp pose without using any feedback [3].”
From Dual Quaternion-Based Visual Servoing for Grasping Moving Objects (2021) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, they often fail in case of unplanned object movements or when there are uncertainties in the estimated hand to object relative poses.”
From Dual Quaternion-Based Visual Servoing for Grasping Moving Objects (2021) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Separate visual pathways for perception and action
Goodale, M. A., & Milner, A. D. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90344-8 · Cited by 6,519
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306 · cited 2×
“It is represented relative to a potential grasping point by shape contexts as introduced by Belongie et al. [64].”
BackgroundBasic objects in natural categories
Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., & Boyes-Braem, P. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90013-x · Cited by 5,643
Visual categorization with bags of keypoints
Csurka, G. (2004) · European Conference on Computer Vision · Cited by 5,030
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
A large-scale hierarchical multi-view RGB-D object dataset
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980382 · Cited by 1,316
Shotton, J., Winn, J., Rother, C., & Criminisi, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_1 · Cited by 1,132
Miller, A. T., & Allen, P. K. (2004) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2004.1371616 · Cited by 1,023
Robotic Grasping of Novel Objects using Vision
Saxena, A., Driemeyer, J., & Ng, A. Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364907087172 · Cited by 923
Constructing Force- Closure Grasps
Nguyen, V.-D. (1988) · The International Journal of Robotics Research · doi:10.1177/027836498800700301 · Cited by 902
Ferrari, C., & Canny, J. (2003) · Proceedings 1992 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1992.219918 · Cited by 893
Fast 3D recognition and pose using the Viewpoint Feature Histogram
Rusu, R. B., Bradski, G., Thibaux, R., & Hsu, J. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5651280 · Cited by 847
Automatic grasp planning using shape primitives
Miller, A. T., Knoop, S., Christensen, H. I., & Allen, P. K. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241860 · Cited by 705
Robot Grasp Synthesis Algorithms: A Survey
Shimoga, K. B. (1996) · The International Journal of Robotics Research · doi:10.1177/027836499601500302 · Cited by 666
Castiello, U. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1744 · Cited by 621
Groups of Adjacent Contour Segments for Object Detection
Ferrari, V., Fevrier, L., Jurie, F., & Schmid, C. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1144 · Cited by 563
An overview of 3D object grasp synthesis algorithms
Sahbani, A., El-Khoury, S., & Bidaud, P. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.016 · Cited by 478
The role of parietal cortex in visuomotor control: What have we learned from neuroimaging?
Culham, J. C., Cavina-Pratesi, C., & Singhal, A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.11.003 · Cited by 461
The MOPED framework: Object recognition and pose estimation for manipulation
Collet, A., Martinez, M., & Srinivasa, S. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911401765 · Cited by 421
Maitin-Shepard, J., Cusumano-Towner, M., Lei, J., & Abbeel, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509439 · Cited by 418 · cited 4×
“Bottom) Re-grasping a towel for unfolding [114].”
BackgroundMethodInfluentialHuman-Inspired Robotic Grasp Control With Tactile Sensing
Romano, J. M., Hsiao, K., Niemeyer, G., Chitta, S., & Kuchenbecker, K. J. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2162271 · Cited by 413
Hand Posture Subspaces for Dexterous Robotic Grasping
Ciocarlie, M. T., & Allen, P. K. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364909105606 · Cited by 409
Learning Object Affordances: From Sensory--Motor Coordination to Imitation
Montesano, L., Lopes, M., Bernardino, A., & Santos-Victor, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.914848 · Cited by 356
Goldfeder, C., Ciocarlie, M., Dang, H., & Allen, P. K. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152709 · Cited by 309
Object recognition and full pose registration from a single image for robotic manipulation
Collet, A., Berenson, D., Srinivasa, S. S., & Ferguson, D. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152739 · Cited by 275
Online movement adaptation based on previous sensor experiences
Pastor, P., Righetti, L., Kalakrishnan, M., & Schaal, S. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6095059 · Cited by 219
Robotic roommates making pancakes
Beetz, M., Klank, U., Kresse, I., Maldonado, A., Mosenlechner, L., Pangercic, D., Ruhr, T., & Tenorth, M. (2011) · 2011 11th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2011.6100855 · Cited by 217
Better Vision through Manipulation
Metta, G., & Fitzpatrick, P. (2003) · Adaptive Behavior · doi:10.1177/10597123030112004 · Cited by 216
An SVM learning approach to robotic grasping
Pelossof, R., Miller, A., Allen, P., & Jebara, T. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1308797 · Cited by 216
Grasp Planning via Decomposition Trees
Goldfeder, C., Allen, P. K., Lackner, C., & Pelossof, R. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.364200 · Cited by 216
Prattichizzo, D., & Trinkle, J. C. (2008) · Springer Handbook of Robotics · doi:10.1007/978-3-540-30301-5_29 · Cited by 206
Contact-reactive grasping of objects with partial shape information
Hsiao, K., Chitta, S., Ciocarlie, M., & Jones, E. G. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5649494 · Cited by 201
Sparse distance learning for object recognition combining RGB and depth information
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980377 · Cited by 189
Combining active learning and reactive control for robot grasping
Kroemer, O., Detry, R. J., Piater, J., & Peters, J. (2010) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2010.06.001 · Cited by 179
Pose error robust grasping from contact wrench space metrics
Weisz, J., & Allen, P. K. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224697 · Cited by 171
Reactive grasping using optical proximity sensors
Hsiao, K., Nangeroni, P., Huber, M., Saxena, A., & Ng, A. Y. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152849 · Cited by 162
Rigid 3D geometry matching for grasping of known objects in cluttered scenes
Papazov, C., Haddadin, S., Parusel, S., Krieger, K., & Burschka, D. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911436019 · Cited by 160
Grasping the dice by dicing the grasp
Borst, C., Fischer, M., & Hirzinger, G. (2004) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2003.1249729 · Cited by 158
Computation of Independent Contact Regions for Grasping 3-D Objects
Roa, M. A., & Suárez, R. (2009) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2020351 · Cited by 156
Learning grasping points with shape context
Bohg, J., & Kragić, D. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.10.003 · Cited by 153
Self-citationLearning grasp strategies with partial shape information
Saxena, A., Wong, L. L. S., & Ng, A. Y. (2008) · Cited by 149
General 3D modelling of novel objects from a single view
Márton, Z.-C., Pangercic, D., Blodow, N., Kleinehellefort, J., & Beetz, M. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5650434 · Cited by 135
Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps
Balasubramanian, R., Xu, L., Brook, P. D., Smith, J. R., & Matsuoka, Y. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2189498 · Cited by 130
Learning to grasp objects with multiple contact points
Le, Q. V., Kamm, D., Kara, A. F., & Ng, A. Y. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509508 · Cited by 129
Selection of robot pre-grasps using box-based shape approximation
Huebner, K., & Kragić, D. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650722 · Cited by 128
Konolige, K. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509796 · Cited by 127
Grasping novel objects with depth segmentation
Rao, D., Le, Q. V., Phoka, T., Quigley, M., Sudsang, A., & Ng, A. Y. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5650493 · Cited by 125
Using depth and appearance features for informed robot grasping of highly wrinkled clothes
Ramisa, A., Alenya, G., Moreno-Noguer, F., & Torras, C. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225045 · Cited by 124
Goldfeder, C., & Allen, P. K. (2011) · Autonomous Robots · doi:10.1007/s10514-011-9228-1 · Cited by 120
Morales, A., Asfour, T., Azad, P., Knoop, S., & Dillmann, R. (2006) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2006.282367 · Cited by 118
Self-citationMind the gap - robotic grasping under incomplete observation
Bohg, J., Johnson‐Roberson, M., León, B., Felip, J., Gratal, X., Bergström, N., Kragić, D., & Morales, A. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980354 · Cited by 117
Self-citationToward humanoid manipulation in human-centred environments
Asfour, T., Azad, P., Vahrenkamp, N., Regenstein, K., Bierbaum, A., Welke, K., Schröder, J., & Dillmann, R. (2007) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2007.09.013 · Cited by 115
Self-citationVisual Grasp Planning for Unknown Objects Using a Multifingered Robotic Hand
Lippiello, V., Ruggiero, F., Siciliano, B., & Villani, L. (2013) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2012.2195500 · Cited by 114
Detecting and segmenting objects for mobile manipulation
Rusu, R. B., Holzbach, A., Beetz, M., & Bradski, G. R. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457718 · Cited by 111
Combined 2D–3D categorization and classification for multimodal perception systems
Marton, Z.-C., Pangercic, D., Blodow, N., & Beetz, M. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911415897 · Cited by 110
An Implicit Shape Model for Combined Object Categorization and Segmentation
Leibe, B., Leonardis, A., & Schiele, B. (2006) · Lecture notes in computer science · doi:10.1007/11957959_26 · Cited by 109
Learning and Evaluation of the Approach Vector for Automatic Grasp Generation and Planning
Ekvall, S., & Kragić, D. (2007) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2007.364205 · Cited by 109
On the manipulability ellipsoids of underactuated robotic hands with compliance
Prattichizzo, D., Malvezzi, M., Gabiccini, M., & Bicchi, A. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.014 · Cited by 108
Functional Object Class Detection Based on Learned Affordance Cues
Stark, M. M., Lies, P., Zillich, M., Wyatt, J., & Schiele, B. (2008) · Springer eBooks · doi:10.1007/978-3-540-79547-6_42 · Cited by 106
Tenorth, M., Clifford Perzylo, A., Lafrenz, R., & Beetz, M. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224812 · Cited by 105
Template-based learning of grasp selection
Herzog, A., Pástor, P., Kalakrishnan, M., Righetti, L., Asfour, T., & Stefan Schaal, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225271 · Cited by 100
Self-citationInteractive segmentation for manipulation in unstructured environments
Kenney, J., Buckley, T., & Brock, O. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152393 · Cited by 99
Grasping with application to an autonomous checkout robot
Klingbeil, E., Rao, D., Carpenter, B., Ganapathi, V., Ng, A. Y., & Khatib, O. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980287 · Cited by 91
Automated modeling and robotic grasping of unknown three-dimensional objects
Bone, G. M., Lambert, A., & Edwards, M. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543223 · Cited by 88
Semantic grasping: Planning robotic grasps functionally suitable for an object manipulation task
Dang, H., & Allen, P. K. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385563 · Cited by 84
Vision-based three-finger grasp synthesis constrained by hand geometry
Morales, A., Sanz, P. J., del Pobil, A. P., & Fagg, A. H. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.01.002 · Cited by 82
Self-citationRobust sensor-based grasp primitive for a three-finger robot hand
Felip, J., & Morales, A. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354760 · Cited by 81
Self-citationKRAFT, D., PUGEAULT, N., BAŞESKI, E., POPOVIĆ, M., KRAGIĆ, D., KALKAN, S., WÖRGÖTTER, F., & KRÜGER, N. (2008) · International Journal of Humanoid Robotics · doi:10.1142/s021984360800139x · Cited by 80
On the synthesis of feasible and prehensile robotic grasps
Rosales, C., Suárez, R., Gabiccini, M., & Bicchi, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225238 · Cited by 80
USING EXPERIENCE FOR ASSESSING GRASP RELIABILITY
Morales, A., Chinellato, E., Fagg, A. H., & del Pobil, A. P. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000290 · Cited by 77
Self-citationA kernel-based approach to direct action perception
Kroemer, O., Ugur, E., Oztop, E., & Peters, J. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224957 · Cited by 73
Zhang, L., & Trinkle, J. C. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225125 · Cited by 72
A shape matching algorithm for synthesizing humanlike enveloping grasps
Li, Y., & Pollard, N. S. (2006) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2005.1573607 · Cited by 71
Learning object-specific grasp affordance densities
Detry, R., Baseski, E., Popovic, M., Touati, Y., Kruger, N., Kroemer, O., Peters, J., & Piater, J. (2009) · 2009 IEEE 8th International Conference on Development and Learning · doi:10.1109/devlrn.2009.5175520 · Cited by 70
Kehoe, B., Berenson, D., & Goldberg, K. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224781 · Cited by 67
A Probabilistic Framework for 3D Visual Object Representation
Detry, R., Pugeault, N., & Piater, J. H. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.64 · Cited by 67
Multivariate discretization for Bayesian Network structure learning in robot grasping
Song, D., Ek, C. H., Huebner, K., & Kragić, D. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979666 · Cited by 65
Demonstration-based learning and control for automatic grasping
Tegin, J., Ekvall, S., Kragić, D., Wikander, J., & Iliev, B. (2008) · Intelligent Service Robotics · doi:10.1007/s11370-008-0026-3 · Cited by 63
Przybylski, M., Asfour, T., & Dillmann, R. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094937 · Cited by 62
Self-citationUnions of balls for shape approximation in robot grasping
Przybylski, M., Asfour, T., & Dillmann, R. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5653520 · Cited by 60
Self-citationEmpty the basket - a shape based learning approach for grasping piles of unknown objects
Fischinger, D., & Vincze, M. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386137 · Cited by 60
Generalizing grasps across partly similar objects
Detry, R. J., Ek, C. H., Madry, M., Piater, J., & Kragić, D. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224992 · Cited by 59
Efficient and effective grasping of novel objects through learning and adapting a knowledge base
Curtis, N. R., & Xiao, J. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4651062 · Cited by 59
Grasping unknown objects using an Early Cognitive Vision system for general scene understanding
Popovic, M., Kootstra, G., Jorgensen, J. A., Kragic, D., & Kruger, N. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094932 · Cited by 58
Power grasp planning for anthropomorphic robot hands
Roa, M. A., Argus, M. J., Leidner, D. S., Borst, C., & Hirzinger, G. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225068 · Cited by 57
From object categories to grasp transfer using probabilistic reasoning
Madry, M., Song, D., & Kragić, D. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225052 · Cited by 55
Collaborative grasp planning with multiple object representations
Brook, P., Ciocarlie, M., & Hsiao, K. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980490 · Cited by 54
Active rough shape estimation of unknown objects
Dune, C., Marchand, É., Collowet, C., & Leroux, C. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4651005 · Cited by 54
Transferring functional grasps through contact warping and local replanning
Hillenbrand, U., & Roa, M. A. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385989 · Cited by 50
Active learning of visual descriptors for grasping using non-parametric smoothed beta distributions
Montesano, L., & Lopes, M. C. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.013 · Cited by 47
Ulbrich, S., Kappler, D., Asfour, T., Vahrenkamp, N., Bierbaum, A., Przybylski, M., & Dillmann, R. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094894 · Cited by 46
Self-citationEnd-to-end dexterous manipulation with deliberate interactive estimation
Hudson, N., Howard, T. M., Ma, J., Jain, A., Bajracharya, M., Myint, S., Kuo, C., Matthies, L. H., Backes, P., Hebert, P. D. N., et al. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225101 · Cited by 45
Probabilistic categorization of kitchen objects in table settings with a composite sensor
Márton, Z.-C., Rusu, R. B., Jain, D., Klank, U., & Beetz, M. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354288 · Cited by 45
Robotic grasping of unmodeled objects using time-of-flight range data and finger torque information
Maldonado, A., Klank, U., & Beetz, M. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5649185 · Cited by 43
On the efficient computation of independent contact regions for force closure grasps
Krug, R., Dimitrov, D., Charusta, K., & Iliev, B. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5654380 · Cited by 42
Refining grasp affordance models by experience
Detry, R. J., Kraft, D., Buch, A. G., Krüger, N., & Piater, J. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509126 · Cited by 40
Learning robot grasping from 3-D images with Markov Random Fields
Boularias, A., Kroemer, O., & Peters, J. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094888 · Cited by 40
Learning motion primitive goals for robust manipulation
Stulp, F., Theodorou, E., Kalakrishnan, M., Pastor, P., Righetti, L., & Schaal, S. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094877 · Cited by 38
Grasping known objects with humanoid robots: A box-based approach
Huebner, K., Welke, K., Przybylski, M., Vahrenkamp, N., Asfour, T., Kragić, D., & Dillmann, R. (2009) · Cited by 38
Self-citationSegmentation and learning of unknown objects through physical interaction
Schiebener, D., Ude, A., Morimoto, J., Asfour, T., & Dillmann, R. (2011) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2011.6100843 · Cited by 35
Self-citationShape-based depth image to 3D model matching and classification with inter-view similarity
Wohlkinger, W., & Vincze, M. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094808 · Cited by 33
Vision-based grasp planning of 3D objects by extending 2D contour based algorithms
Speth, J., Morales, A., & Sanz, P. J. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650632 · Cited by 31
Self-citationPlanar, bimanual, whole-arm grasping
Seo, J., Kim, S., & Kumar, V. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225086 · Cited by 28
Generating object hypotheses in natural scenes through human-robot interaction
Bergström, N., Björkman, M., & Kragić, D. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6048162 · Cited by 27
Visual servoing on unknown objects
Gratal, X., Romero, J., Bohg, J., & Kragić, D. (2011) · Mechatronics · doi:10.1016/j.mechatronics.2011.09.009 · Cited by 27
Self-citationTowards shape-based visual object categorization for humanoid robots
Gonzalez-Aguirre, D., Hoch, J., Röhl, S., Asfour, T., Bayro-Corrochano, E. J., & Dillmann, R. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980065 · Cited by 20
Self-citationExploiting and modeling local 3D structure for predicting object locations
Aydemir, A., & Jensfelt, P. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386111 · Cited by 19
Chinellato, E., & del Pobil, A. P. (2009) · Journal of Integrative Neuroscience · doi:10.1142/s0219635209002137 · Cited by 17
Modeling and evaluation of human-to-robot mapping of grasps
Romero, J., Kjellström, H., & Kragić, D. (2009) · Cited by 13
Pose Alignment for 3D Models and Single View Stereo Point Clouds Based on Stable Planes
Aldomà, A., & Vincze, M. (2011) · International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission · doi:10.1109/3dimpvt.2011.54 · Cited by 12
Joint Observation of Object Pose and Tactile Imprints for Online Grasp Stability Assessment
Bekiroglu, Y., Detry, R. J., & Kragić, D. (2011) · ORBi (University of Liège) · Cited by 3
Research works printed but not linked: 19
- [24] R. Diankov, 'Automated construction of robotic manipulation programs,' Ph.D. dissertation, Carnegie Mellon University, Robotics Institute, Aug 2010. -
- [55] J. Glover, D. Rus, and N. Roy, 'Probabilistic models of object geometry for grasp planning,' in Proceedings of Robotics: Science and Systems IV , Zurich, Switzerland, June 2008. -
- [4] A. Bicchi and V. Kumar, 'Robotic grasping and contact,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , San Francisco, Apr. 2000, invited paper. -
- [3] R. N. Murray, Z. Li, and S. Sastry, A Mathematical Introduction to Robotics Manipulation . CRC Press, 1994. -
- [5] I. Kamon, T. Flash, and S. Edelman, 'Learning to grasp using visual information,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , 1994, pp. 2470-2476. -
- [127] K. Hsiao, M. Ciocarlie, and P. Brook, 'Bayesian grasp planning,' in ICRA 2011 Workshop on Mobile Manipulation: Integrating Perception and Manipulation , 2011. -
- [73] P. Azad, T. Asfour, and R. Dillmann, 'Stereo-based 6d object localization for grasping with humanoid robot systems,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , 2007, pp. 919-924. -
- [131] N. Bergström, C. H. Ek, M. Björkman, and D. Kragic, 'Generating object hypotheses in natural scenes through human-robot interaction,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , San Francisco,USA, Sep 2011, pp. 827-833. -
- [77] C. Papazov and D. Burschka, 'An efficient ransac for 3d object recognition in noisy and occluded scenes.' in ACCV (1) , ser. Lecture Notes in Computer Science, R. Kimmel, R. Klette, and A. Sugimoto, Eds., vol. 6492. Springer, 2010, pp. 135-148. -
- [75] M. Ciocarlie, K. Hsiao, E. G. Jones, S. Chitta, R. B. Rusu, and I. A. Sucan, 'Towards reliable grasping and manipulation in household environments,' in Int. Symposium on Experimental Robotics (ISER) , New Delhi, India, Dec 2010. -
- [76] P. J. Besl and N. D. McKay, 'A method for registration of 3-d shapes,' IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI) , vol. 14, pp. 239-256, 1992. -
- [67] K. Hübner and D. Kragic, 'Selection of Robot Pre-Grasps using BoxBased Shape Approximation,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , 2008, pp. 1765-1770. -
- [70] M. Do, J. Romero, H. Kjellström, P. Azad, T. Asfour, D. Kragic, and R. Dillmann, 'Grasp Recognition and Mapping on Humanoid Robots,' in IEEE/RAS Int. Conf. on Humanoid Robots (Humanoids) , Paris, France, Dec 2009. -
- [92] --, 'Learning a Dictionary of Prototypical Grasp-predicting Parts from Grasping Experience,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , 2013, to appear. -
- [99] J. Bohg, K. Welke, B. León, M. Do, D. Song, W. Wohlkinger, M. Madry, A. Aldóma, M. Przybylski, T. Asfour, H. Martí, D. Kragic, A. Morales, and M. Vincze, 'Task-based grasp adaptation on a humanoid robot,' in Int. IFAC Symposium on Robot Control (SYROCO) , Dubrovnik,Croatia, Sep 2012, pp. 852 - 859. -
- [97] N. Bergström, J. Bohg, and D. Kragic, 'Integration of visual cues for robotic grasping,' in Computer Vision Systems , ser. Lecture Notes in Computer Science, vol. 5815. Springer Berlin / Heidelberg, 2009, pp. 245-254. -
- [119] M. Richtsfeld and M. Vincze, 'Grasping of Unknown Objects from a Table Top,' in ECCV Workshop on 'Vision in Action: Efficient strategies for cognitive agents in complex environments' , Marseille, France, Sep 2008. -
- [121] J. Stückler, R. Steffens, D. Holz, and S. Behnke, 'Real-Time 3D Perception and Efficient Grasp Planning for Everyday Manipulation Tasks,' in European Conf. on Mobile Robots (ECMR) , Örebro, Sweden, Sep 2011. -
- [89] S. El-Khoury and A. Sahbani, 'Handling Objects By Their Handles,' in IROS-2008 Workshop on Grasp and Task Learning by Imitation , 2008. -
Cited by
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Mahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Aparicio, J., & Goldberg, K. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.058 · Cited by 1,268
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
Metadata
- Authors
- Bohg, J., Morales, A., Asfour, T., & Kragic, D.
- Affiliations
- Max Planck Institute for Intelligent Systems (DE)
- Universitat Jaume I (ES)
- Karlsruhe Institute of Technology (DE)
- ORCID
- Bohg, Jeannette
- Venue
- IEEE Transactions on Robotics
- Published
- 2014-04
- Volume
- 30
- Issue
- 2
- Pages
- 289-309
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2036637075
- Cited by
- 929
- References
- 119
- Citations by year
- 2026: 60 · 2025: 68 · 2024: 92 · 2023: 93 · 2022: 105 · 2021: 123 · 2020: 90 · 2019: 92 · 2018: 70 · 2017: 53 · 2016: 47 · 2015: 21 · 2014: 13
- FWCI
- 49.73
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Repositori UJI (Universitat Jaume I) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- robotic grasping, object recognition, pose estimation, similarity matching, familiar objects, unknown object, object representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.