Data-Driven Grasp Synthesis—A Survey
Open accessThe DOI matches its Crossref record; 115 of the 119 references it cites were found in a registry or an index.
Abstract
We review the work on data-driven grasp synthesis and the methodologies for sampling and ranking candidate grasps. We divide the approaches into three groups based on whether they synthesize grasps for known, familiar, or unknown objects. This structure allows us to identify common object representations and perceptual processes that facilitate the employed data-driven grasp synthesis technique. In the case of known objects, we concentrate on the approaches that are based on object recognition and pose estimation. In the case of familiar objects, the techniques use some form of a similarity matching to a set of previously encountered objects. Finally, for the approaches dealing with unknown objects, the core part is the extraction of specific features that are indicative of good grasps. Our survey provides an overview of the different methodologies and discusses open problems in the area of robot grasping. We also draw a parallel to the classical approaches that rely on analytic formulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most of the existing state-of-the-art in grasping are oneshot , i.e. , they perceive once and plan grasps assuming the object is stationary; the arm is then commanded to the grasp pose without using any feedback [3].”
From Dual Quaternion-Based Visual Servoing for Grasping Moving Objects (2021) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, they often fail in case of unplanned object movements or when there are uncertainties in the estimated hand to object relative poses.”
From Dual Quaternion-Based Visual Servoing for Grasping Moving Objects (2021) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Separate visual pathways for perception and action
Goodale, M. A., & Milner, A. D. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90344-8 · Cited by 6,519
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306 · cited 2×
“It is represented relative to a potential grasping point by shape contexts as introduced by Belongie et al. [64].”
BackgroundBasic objects in natural categories
Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., & Boyes-Braem, P. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90013-x · Cited by 5,643
Visual categorization with bags of keypoints
Csurka, G. (2004) · European Conference on Computer Vision · Cited by 5,030
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Li, F.-F., & Perona, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.16 · Cited by 3,613
A large-scale hierarchical multi-view RGB-D object dataset
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980382 · Cited by 1,316
Research works printed but not linked: 19
- [24] R. Diankov, 'Automated construction of robotic manipulation programs,' Ph.D. dissertation, Carnegie Mellon University, Robotics Institute, Aug 2010. -
- [55] J. Glover, D. Rus, and N. Roy, 'Probabilistic models of object geometry for grasp planning,' in Proceedings of Robotics: Science and Systems IV , Zurich, Switzerland, June 2008. -
- [4] A. Bicchi and V. Kumar, 'Robotic grasping and contact,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , San Francisco, Apr. 2000, invited paper. -
- [3] R. N. Murray, Z. Li, and S. Sastry, A Mathematical Introduction to Robotics Manipulation . CRC Press, 1994. -
- [5] I. Kamon, T. Flash, and S. Edelman, 'Learning to grasp using visual information,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , 1994, pp. 2470-2476. -
- [127] K. Hsiao, M. Ciocarlie, and P. Brook, 'Bayesian grasp planning,' in ICRA 2011 Workshop on Mobile Manipulation: Integrating Perception and Manipulation , 2011. -
- [73] P. Azad, T. Asfour, and R. Dillmann, 'Stereo-based 6d object localization for grasping with humanoid robot systems,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , 2007, pp. 919-924. -
- [131] N. Bergström, C. H. Ek, M. Björkman, and D. Kragic, 'Generating object hypotheses in natural scenes through human-robot interaction,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , San Francisco,USA, Sep 2011, pp. 827-833. -
- [77] C. Papazov and D. Burschka, 'An efficient ransac for 3d object recognition in noisy and occluded scenes.' in ACCV (1) , ser. Lecture Notes in Computer Science, R. Kimmel, R. Klette, and A. Sugimoto, Eds., vol. 6492. Springer, 2010, pp. 135-148. -
- [75] M. Ciocarlie, K. Hsiao, E. G. Jones, S. Chitta, R. B. Rusu, and I. A. Sucan, 'Towards reliable grasping and manipulation in household environments,' in Int. Symposium on Experimental Robotics (ISER) , New Delhi, India, Dec 2010. -
- [76] P. J. Besl and N. D. McKay, 'A method for registration of 3-d shapes,' IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI) , vol. 14, pp. 239-256, 1992. -
- [67] K. Hübner and D. Kragic, 'Selection of Robot Pre-Grasps using BoxBased Shape Approximation,' in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , 2008, pp. 1765-1770. -
- [70] M. Do, J. Romero, H. Kjellström, P. Azad, T. Asfour, D. Kragic, and R. Dillmann, 'Grasp Recognition and Mapping on Humanoid Robots,' in IEEE/RAS Int. Conf. on Humanoid Robots (Humanoids) , Paris, France, Dec 2009. -
- [92] --, 'Learning a Dictionary of Prototypical Grasp-predicting Parts from Grasping Experience,' in IEEE Int. Conf. on Robotics and Automation (ICRA) , 2013, to appear. -
- [99] J. Bohg, K. Welke, B. León, M. Do, D. Song, W. Wohlkinger, M. Madry, A. Aldóma, M. Przybylski, T. Asfour, H. Martí, D. Kragic, A. Morales, and M. Vincze, 'Task-based grasp adaptation on a humanoid robot,' in Int. IFAC Symposium on Robot Control (SYROCO) , Dubrovnik,Croatia, Sep 2012, pp. 852 - 859. -
- [97] N. Bergström, J. Bohg, and D. Kragic, 'Integration of visual cues for robotic grasping,' in Computer Vision Systems , ser. Lecture Notes in Computer Science, vol. 5815. Springer Berlin / Heidelberg, 2009, pp. 245-254. -
- [119] M. Richtsfeld and M. Vincze, 'Grasping of Unknown Objects from a Table Top,' in ECCV Workshop on 'Vision in Action: Efficient strategies for cognitive agents in complex environments' , Marseille, France, Sep 2008. -
- [121] J. Stückler, R. Steffens, D. Holz, and S. Behnke, 'Real-Time 3D Perception and Efficient Grasp Planning for Everyday Manipulation Tasks,' in European Conf. on Mobile Robots (ECMR) , Örebro, Sweden, Sep 2011. -
- [89] S. El-Khoury and A. Sahbani, 'Handling Objects By Their Handles,' in IROS-2008 Workshop on Grasp and Task Learning by Imitation , 2008. -
Cited by
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Mahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Aparicio, J., & Goldberg, K. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.058 · Cited by 1,268
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
A Survey of Research on Cloud Robotics and Automation
Kehoe, B., Patil, S., Abbeel, P., & Goldberg, K. (2015) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2376492 · Cited by 833
Recent Advances in Robot Learning from Demonstration
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-100819-063206 · Cited by 752
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., Vanhoucke, V., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.10293 · Cited by 697
Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping
Bousmalis, K., Irpan, A., Wohlhart, P., Bai, Y., Kelcey, M., Kalakrishnan, M., Downs, L., Ibarz, J., Pastor, P., Konolige, K., et al. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460875 · Cited by 636
Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach
Morrison, D., Leitner, J., & Corke, P. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.021 · Cited by 630
6-DOF GraspNet: Variational Grasp Generation for Object Manipulation
Mousavian, A., Eppner, C., & Fox, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00299 · Cited by 571
Learning ambidextrous robot grasping policies
Mahler, J., Matl, M., Satish, V., Danielczuk, M., DeRose, B., McKinley, S., & Goldberg, K. (2019) · Science Robotics · doi:10.1126/scirobotics.aau4984 · Cited by 563
Learning robust, real-time, reactive robotic grasping
Morrison, D., Corke, P., & Leitner, J. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919859066 · Cited by 489
Neural Fields in Visual Computing and Beyond
Xie, Y., Takikawa, T., Saito, S., Litany, O., Yan, S., Khan, N., Tombari, F., Tompkin, J., sitzmann, V., & Sridhar, S. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14505 · Cited by 484
Du, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
Real-World Multiobject, Multigrasp Detection
Chu, F.-J., Xu, R., & Vela, P. A. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852777 · Cited by 453
Antipodal Robotic Grasping using Generative Residual Convolutional Neural Network
Kumra, S., Joshi, S., & Sahin, F. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340777 · Cited by 437
James, S., Wohlhart, P., Kalakrishnan, M., Kalashnikov, D., Irpan, A., Ibarz, J., Levine, S., Hadsell, R., & Bousmalis, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01291 · Cited by 420
“Robotic grasping is a well studied problem [2].”
BackgroundMahler, J., Pokorny, F. T., Hou, B., Roderick, M., Laskey, M., Aubry, M., Kohlhoff, K., Kroger, T., Kuffner, J., & Goldberg, K. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487342 · Cited by 359
More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch
Calandra, R., Owens, A., Jayaraman, D., Lin, J., Yuan, W., Malik, J., Adelson, E. H., & Levine, S. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852779 · Cited by 359
PointNetGPD: Detecting Grasp Configurations from Point Sets
Liang, H., Ma, X., Li, S., Gorner, M., Tang, S., Fang, B., Sun, F., & Zhang, J. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794435 · Cited by 353
A Review of Tactile Information: Perception and Action Through Touch
Li, Q., Kroemer, O., Su, Z., Veiga, F. F., Kaboli, M., & Ritter, H. J. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3003230 · Cited by 332
Mahler, J., Matl, M., Liu, X., Li, A., Gealy, D., & Goldberg, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460887 · Cited by 323
A Survey on Learning-Based Robotic Grasping
Kleeberger, K., Bormann, R., Kraus, W., & Huber, M. F. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00021-6 · Cited by 290
AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains
Fang, H.-S., Wang, C., Fang, H., Gou, M., Liu, J., Yan, H., Liu, W., Xie, Y., & Lu, C. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3281153 · Cited by 276
Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection
Levine, S., Pastor, P., Krizhevsky, A., & Quillen, D. (2017) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-50115-4_16 · Cited by 274
Leveraging big data for grasp planning
Kappler, D., Bohg, J., & Schaal, S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139793 · Cited by 268
Self-citationThe Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes?Preprint
Calandra, R., Owens, A., Upadhyaya, M., Yuan, W., Lin, J., Adelson, E. H., & Levine, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.05512 · Cited by 266
Deep Learning Approaches to Grasp Synthesis: A Review
Newbury, R., Gu, M., Chumbley, L., Mousavian, A., Eppner, C., Leitner, J., Bohg, J., Morales, A., Asfour, T., Kragic, D., et al. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3280597 · Cited by 255
Self-citationTowards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning
Chen, Y., Wu, T., Wang, S., Feng, X., Jiang, J., Lu, Z., McAleer, S., Dong, H., Zhu, S. C., & Yang, Y. (2022) · neural information processing systems · doi:10.52202/068431-0372 · Cited by 235
Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning
Hua, J., Zeng, L., Li, G., & Ju, Z. (2021) · Sensors · doi:10.3390/s21041278 · Cited by 229
Volumetric Grasping Network: Real-time 6 DOF Grasp Detection in Clutter
Breyer, M., Chung, J. J., Ott, L., Siegwart, R., & Nieto, J. I. (2020) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000529161 · Cited by 226
Language-Driven Representation Learning for Robotics
Karamcheti, S., Nair, S., Chen, A., Kollar, T., Finn, C., Sadigh, D., & Liang, P. (2023) · Robotics: Science and Systems XIX · doi:10.15607/rss.2023.xix.032 · Cited by 68
(2021) · Journal of Machine Learning Research · Cited by 224
Quillen, D., Jang, E., Nachum, O., Finn, C., Ibarz, J., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461039 · Cited by 219
Review of Deep Learning Methods in Robotic Grasp Detection
Caldera, S., Rassau, A., & Chai, D. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2030057 · Cited by 219
A hybrid deep architecture for robotic grasp detection
Guo, D., Sun, F., Liu, H., Kong, T., Fang, B., & Xi, N. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989191 · Cited by 217
Ainetter, S., & Fraundorfer, F. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561398 · Cited by 214
Domain Randomization and Generative Models for Robotic Grasping
Tobin, J., Biewald, L., Duan, R., Andrychowicz, M., Handa, A., Kumar, V., McGrew, B., Ray, A., Schneider, J., Welinder, P., et al. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593933 · Cited by 155
6-DOF Grasping for Target-driven Object Manipulation in Clutter
Murali, A., Mousavian, A., Eppner, C., Paxton, C., & Fox, D. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197318 · Cited by 202
Grasping Field: Learning Implicit Representations for Human Grasps
Karunratanakul, K., Yang, J., Zhang, Y., Black, M. J., Muandet, K., & Tang, S. (2020) · 2020 International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00043 · Cited by 198
Object Handovers: A Review for Robotics
Ortenzi, V., Cosgun, A., Pardi, T., Chan, W. P., Croft, E., & Kulic, D. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3075365 · Cited by 198
Intelligent In‐Vehicle Interaction Technologies
Murali, P. K., Kaboli, M., & Dahiya, R. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100122 · Cited by 197
Liu, T., Liu, Z., Jiao, Z., Zhu, Y., & Zhu, S. C. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3129138 · Cited by 197
The Curious Robot: Learning Visual Representations via Physical Interactions
Pinto, L., Gandhi, D., Han, Y., Park, Y.-L., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_1 · Cited by 156
Partially Observable Markov Decision Processes in Robotics: A Survey
Lauri, M., Hsu, D., & Pajarinen, J. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3200138 · Cited by 188
Ni, P., Zhang, W., Zhu, X., & Cao, Q. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196740 · Cited by 188
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense
Zhu, Y., Gao, T., Fan, L., Huang, S., Edmonds, M., Liu, H., Gao, F., Zhang, C., Qi, S., Wu, Y. N., et al. (2020) · Engineering · doi:10.1016/j.eng.2020.01.011 · Cited by 132
Learning task-oriented grasping for tool manipulation from simulated self-supervision
Fang, K., Zhu, Y., Garg, A., Kurenkov, A., Mehta, V., Fei-Fei, L., & Savarese, S. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364919872545 · Cited by 180
UniGrasp: Learning a Unified Model to Grasp With Multifingered Robotic Hands
Shao, L., Ferreira, F., Jorda, M., Nambiar, V., Luo, J., Solowjow, E., Ojea, J. A., Khatib, O., & Bohg, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969946 · Cited by 180
Self-citationVisual Affordance and Function Understanding: A Survey
Hassanin, M., Khan, S. H., & Tahtalı, M. (2021) · ACM Computing Surveys · doi:10.1145/3446370 · Cited by 175
A Survey of Robotic Harvesting Systems and Enabling Technologies
Δρούκας, Λ., Doulgeri, Z., Tsakiridis, N., Triantafyllou, D., Kleitsiotis, I., Mariolis, I. G., Giakoumis, D., Tzovaras, D. K., Katerıs, D., & Bochtis, D. (2023) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-022-01793-z · Cited by 173
PiGraphs: learning interaction snapshots from observations
Savva, M., Chang, A. X., Hanrahan, P., Fisher, M., & Nießner, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925867 · Cited by 131
Semantics for Robotic Mapping, Perception and Interaction: A Survey
Garg, S., Sünderhauf, N., Dayoub, F., Morrison, D., Cosgun, A., Carneiro, G., Wu, Q., Chin, T.-J., Reid, I., Gould, S., et al. (2020) · Foundations and Trends® in Robotics · doi:10.1561/2300000059 · Cited by 105
Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias
Gupta, A., Murali, A., Gandhi, D., & Pinto, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.07049 · Cited by 56
Robot grasp detection using multimodal deep convolutional neural networks
Wang, Z., Li, Z., Wang, B., & Liu, H. (2016) · Advances in Mechanical Engineering · doi:10.1177/1687814016668077 · Cited by 165
RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images
Gou, M., Fang, H.-S., Zhu, Z., Xu, S., Wang, C., & Lu, C. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561409 · Cited by 171
Nguyen, A., Kanoulas, D., Caldwell, D. G., & Tsagarakis, N. G. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206484 · Cited by 163
Affordances in Psychology, Neuroscience, and Robotics: A Survey
Jamone, L., Ugur, E., Cangelosi, A., Fadiga, L., Bernardino, A., Piater, J., & Santos-Victor, J. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2594134 · Cited by 163
“[204] divide data-driven approaches into three groups: grasping known, familiar and unknown objects.”
BackgroundMethodProximity Perception in Human-centered Robotics: A Survey on Sensing Systems and Applications
Navarro, S. E., Muhlbacher-Karrer, S., Alagi, H., Zangl, H., Koyama, K., Hein, B., Duriez, C., & Smith, J. R. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3111786 · Cited by 162
“In fact, the traditional, human-like preshaping can be considered to be a high-level behavior (BT-II) and is the result of grasp synthesis or grasp planning , which is an active research field [126].”
BackgroundFrom grasping to manipulation with gecko-inspired adhesives on a multifinger gripper
Ruotolo, W., Brouwer, D., & Cutkosky, M. R. (2021) · Science Robotics · doi:10.1126/scirobotics.abi9773 · Cited by 162
Learning Object Grasping for Soft Robot Hands
Choi, C., Schwarting, W., DelPreto, J., & Rus, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2810544 · Cited by 161
RL-CycleGAN: Reinforcement Learning Aware Simulation-to-Real
Rao, K., Harris, C., Irpan, A., Levine, S., Ibarz, J., & Khansari, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01117 · Cited by 160
Robotic Grasping using Deep Reinforcement Learning
Joshi, S., Kumra, S., & Sahin, F. (2020) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case48305.2020.9216986 · Cited by 157
Learning to push by grasping: Using multiple tasks for effective learning
Pinto, L., & Gupta, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989249 · Cited by 99
Object Detection Approach for Robot Grasp Detection
Karaoğuz, H., & Jensfelt, P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793751 · Cited by 145
S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes
Qin, Y., Chen, R., Zhu, H., Song, M. J., Xu, J. L., & Su, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14218 · Cited by 64
Habitat 2.0: Training home assistants to rearrange their habitat
Szot, A., Clegg, A., Undersander, E., Wijmans, E., Zhao, Y., Turner, J., Maestre, N., Mukadam, M., Chaplot, D., Maksymets, O., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.14405 · Cited by 143
Jiang, D., Li, G., Sun, Y., Hu, J., Yun, J., & Liu, Y. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02843-w · Cited by 142
Towards learning hierarchical skills for multi-phase manipulation tasks
Kroemer, O., Daniel, C., Neumann, G., van Hoof, H., & Peters, J. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139389 · Cited by 108
Satish, V., Mahler, J., & Goldberg, K. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2895878 · Cited by 141
Generating multi-fingered robotic grasps via deep learning
Varley, J., Weisz, J., Weiss, J., & Allen, P. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354004 · Cited by 120
Optimal Design of a Soft Robotic Gripper for Grasping Unknown Objects
Liu, C.-H., Chen, T.-L., Chiu, C.-H., Hsu, M.-C., Chen, Y., Pai, T.-Y., Peng, W.-G., & Chiang, Y.-P. (2018) · Soft Robotics · doi:10.1089/soro.2017.0121 · Cited by 137
Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulation
Fang, K., Bai, Y., Hinterstoißer, S., Savarese, S., & Kalakrishnan, M. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461041 · Cited by 137
A Deep Learning Approach to Grasping the Invisible
Yang, Y., Liang, H., & Choi, C. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2970622 · Cited by 134
Grasp and dexterous manipulation of multi-fingered robotic hands: a review from a control view point
Ozawa, R., & Tahara, K. (2017) · Advanced Robotics · doi:10.1080/01691864.2017.1365011 · Cited by 135
Stabilizing novel objects by learning to predict tactile slip
Veiga, F. F., van Hoof, H., Peters, J., & Hermans, T. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354090 · Cited by 130
Mohammed, M. Q., Kwek, L. C., & Chua, S. C. (2020) · IEEE Access · doi:10.1109/access.2020.3027923 · Cited by 128
A Survey of Knowledge Representation in Service Robotics
Paulius, D., & Sun, Y. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.005 · Cited by 128
DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects
Bao, C., Xu, H., Qin, Y., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02030 · Cited by 130
Modeling of deformable objects for robotic manipulation: A tutorial and review
Arriola-Rios, V. E., Guler, P., Ficuciello, F., Kragic, D., Siciliano, B., & Wyatt, J. L. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00082 · Cited by 126
Dexterous grasping under shape uncertainty
Li, M., Hang, K., Kragić, D., & Billard, A. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.09.008 · Cited by 128
ContactGrasp: Functional Multi-finger Grasp Synthesis from Contact
Brahmbhatt, S., Handa, A., Hays, J., & Fox, D. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967960 · Cited by 125
“We refer the reader to [25] for an extensive survey of data-driven grasp synthesis.”
BackgroundREGNet: REgion-based Grasp Network for End-to-end Grasp Detection in Point Clouds
Zhao, B., Zhang, H., Lan, X., Wang, H., Tian, Z., & Zheng, N. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561920 · Cited by 126
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
Jiang, Z., Zhu, Y., Svetlik, M., Fang, K., & Zhu, Y. (2021) · Robotics: Science and Systems XVII · doi:10.15607/rss.2021.xvii.024 · Cited by 122
Affordance detection for task-specific grasping using deep learning
Kokić, M., Stork, J. A., Haustein, J. A., & Kragić, D. (2017) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2017.8239542 · Cited by 122
On the choice of grasp type and location when handing over an object
Cini, F., Ortenzi, V., Corke, P., & Controzzi, M. (2019) · Science Robotics · doi:10.1126/scirobotics.aau9757 · Cited by 120
Learning high-DOF reaching-and-grasping via dynamic representation of gripper-object interaction
She, Q., Hu, R., Xu, J., Liu, M., Xu, K., & Huang, H. F. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530091 · Cited by 117
Hierarchical Fingertip Space: A Unified Framework for Grasp Planning and In-Hand Grasp Adaptation
Hang, K., Li, M., Stork, J. A., Bekiroglu, Y., Pokorny, F. T., Billard, A., & Kragic, D. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2588879 · Cited by 103
Learning-based robotic grasping: A review
Xie, Z., Liang, X., & Canale, R. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1038658 · Cited by 114
Shape2Pose: human-centric shape analysis
Kim, V. G., Chaudhuri, S., Guibas, L., & Funkhouser, T. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601117 · Cited by 112
Efficient Learning of Goal-Oriented Push-Grasping Synergy in Clutter
Xu, K., Yu, H., Lai, Q., Wang, Y., & Xiong, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3092640 · Cited by 111
Grasping of Unknown Objects Using Deep Convolutional Neural Networks Based on Depth Images
Schmidt, P., Vahrenkamp, N., Wächter, M., & Asfour, T. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8463204 · Cited by 110
Self-citationRibeiro, E. G., Mendes, R. D. Q., & Grassi, V. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103757 · Cited by 110
Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation
Chen, Y., Geng, Y., Zhong, F., Ji, J., Jiang, J., Lu, Z., Dong, H., & Yang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3339515 · Cited by 107
Diffusion models for robotic manipulation: a survey
Wolf, R., Shi, Y., Liu, S., & Rayyes, R. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1606247 · Cited by 113
TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinement
Zhou, K., Bhatnagar, B. L., Lenssen, J. E., & Pons‐Moll, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20062-5_1 · Cited by 106
NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis
Zhou, A., Kim, M. J., Wang, L., Florence, P., & Finn, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01717 · Cited by 106
A Compliant Adaptive Gripper and Its Intrinsic Force Sensing Method
Xu, W., Zhang, H., Yuan, H., & Liang, B. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3060971 · Cited by 105
Visuo-haptic object perception for robots: an overview
Navarro-Guerrero, N., Toprak, S., Josifovski, J., & Jamone, L. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10091-y · Cited by 105
Metadata
- Authors
- Bohg, J., Morales, A., Asfour, T., & Kragic, D.
- Affiliations
- Max Planck Institute for Intelligent Systems (DE)
- Universitat Jaume I (ES)
- Karlsruhe Institute of Technology (DE)
- ORCID
- Bohg, Jeannette
- Venue
- IEEE Transactions on Robotics
- Published
- 2014-04
- Volume
- 30
- Issue
- 2
- Pages
- 289-309
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2036637075
- Cited by
- 929
- References
- 119
- Citations by year
- 2026: 60 · 2025: 68 · 2024: 92 · 2023: 93 · 2022: 105 · 2021: 123 · 2020: 90 · 2019: 92 · 2018: 70 · 2017: 53 · 2016: 47 · 2015: 21 · 2014: 13
- FWCI
- 49.73
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- Repositori UJI (Universitat Jaume I) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- robotic grasping, object recognition, pose estimation, similarity matching, familiar objects, unknown object, object representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.