Leveraging big data for grasp planning
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
We propose a new large-scale database containing grasps that are applied to a large set of objects from numerous categories. These grasps are generated in simulation and are annotated with different grasp stability metrics. We use a descriptive and efficient representation of the local object shape at which each grasp is applied. Given this data, we present a two-fold analysis: (i) We use crowdsourcing to analyze the correlation of the metrics with grasp success as predicted by humans. The results show that the metric based on physics simulation is a more consistent predictor for grasp success than the standard υ-metric. The results also support the hypothesis that human labels are not required for good ground truth grasp data. Instead the physics-metric can be used to generate datasets in simulation that may then be used to bootstrap learning in the real world. (ii) We apply a deep learning method and show that it can better leverage the large-scale database for prediction of grasp success compared to logistic regression. Furthermore, the results suggest that labels based on the physics-metric are less noisy than those from the υ-metric and therefore lead to a better classification performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 1×
“as unsupervised [18] and supervised pre-training [12], we”
MethodLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Bengio, S. (2010) · Journal of Machine Learning Research · Cited by 2,641
Poisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Data-Driven Grasp Synthesis—A Survey
Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2289018 · Cited by 929
Self-citationRobotic Grasping of Novel Objects using Vision
Saxena, A., Driemeyer, J., & Ng, A. Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364907087172 · Cited by 923
Ferrari, C., & Canny, J. (2003) · Proceedings 1992 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1992.219918 · Cited by 893
1Data-Driven Grasp Synthesis- A Survey
Bohg, J., Morales, A., Asfour, T., & Kragić, D. (2014) · MPG.PuRe (Max Planck Society) · Cited by 529
Self-citationAutomated construction of robotic manipulation programs
Takeo Kanade, A., Kuffner, J., & Diankov, R. (2010) · Cited by 458
Human-Inspired Robotic Grasp Control With Tactile Sensing
Romano, J. M., Hsiao, K., Niemeyer, G., Chitta, S., & Kuchenbecker, K. J. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2162271 · Cited by 413
Goldfeder, C., Ciocarlie, M., Dang, H., & Allen, P. K. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152709 · Cited by 309
Online movement adaptation based on previous sensor experiences
Pastor, P., Righetti, L., Kalakrishnan, M., & Schaal, S. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6095059 · Cited by 219
Self-citationContact-reactive grasping of objects with partial shape information
Hsiao, K., Chitta, S., Ciocarlie, M., & Jones, E. G. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5649494 · Cited by 201
Pose error robust grasping from contact wrench space metrics
Weisz, J., & Allen, P. K. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224697 · Cited by 171
3DNet: Large-scale object class recognition from CAD models
Wohlkinger, W., Aldomà, A., Rusu, R. B., & Vincze, M. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225116 · Cited by 164
Reactive grasping using optical proximity sensors
Hsiao, K., Nangeroni, P., Huber, M., Saxena, A., & Ng, A. Y. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152849 · Cited by 162
Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps
Balasubramanian, R., Xu, L., Brook, P. D., Smith, J. R., & Matsuoka, Y. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2189498 · Cited by 130
Deep Learning for Detecting Robotic Grasps
Lenz, I., Lee, H., & Saxena, A. (2013) · Robotics: Science and Systems IX · doi:10.15607/rss.2013.ix.012 · Cited by 126
ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data
Madry, M., Bo, L., Kragić, D., & Fox, D. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907172 · Cited by 115
Learning of grasp selection based on shape-templates
Herzog, A., Pástor, P., Kalakrishnan, M., Righetti, L., Bohg, J., Asfour, T., & Schaal, S. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9366-8 · Cited by 112
Self-citationAn autonomous manipulation system based on force control and optimization
Righetti, L., Kalakrishnan, M., Pástor, P., Binney, J., Kelly, J. W., Voorhies, R. C., Sukhatme, G. S., & Schaal, S. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9365-9 · Cited by 86
Self-citationRobust sensor-based grasp primitive for a three-finger robot hand
Felip, J., & Morales, A. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354760 · Cited by 81
USING EXPERIENCE FOR ASSESSING GRASP RELIABILITY
Morales, A., Chinellato, E., Fagg, A. H., & del Pobil, A. P. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000290 · Cited by 77
Generalizing grasps across partly similar objects
Detry, R. J., Ek, C. H., Madry, M., Piater, J., & Kragić, D. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224992 · Cited by 68
Robot arm pose estimation through pixel-wise part classification
Bohg, J., Romero, J., Herzog, A., & Schaal, S. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907311 · Cited by 66
Self-citationMultivariate discretization for Bayesian Network structure learning in robot grasping
Song, D., Ek, C. H., Huebner, K., & Kragić, D. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979666 · Cited by 65
Grasping unknown objects using an Early Cognitive Vision system for general scene understanding
Popovic, M., Kootstra, G., Jorgensen, J. A., Kragic, D., & Kruger, N. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094932 · Cited by 58
Exploitation of Environmental Constraints in Human and Robotic Grasping
Deimel, R., Eppner, C., Álvarez-Ruiz, J., Maertens, M., & Brock, O. (2016) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-28872-7_23 · Cited by 44
Refining grasp affordance models by experience
Detry, R. J., Kraft, D., Buch, A. G., Krüger, N., & Piater, J. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509126 · Cited by 40
Cited by
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971
Mahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Aparicio, J., & Goldberg, K. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.058 · Cited by 1,268
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping
Bousmalis, K., Irpan, A., Wohlhart, P., Bai, Y., Kelcey, M., Kalakrishnan, M., Downs, L., Ibarz, J., Pastor, P., Konolige, K., et al. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460875 · Cited by 636
Grasp Pose Detection in Point Clouds
ten Pas, A., Gualtieri, M., Saenko, K., & Platt, R. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917735594 · Cited by 594
Metadata
- Authors
- Kappler, D., Bohg, J., & Schaal, S.
- Venue
- 2015 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2015-05
- Pages
- 4304-4311
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W1503925285
- Cited by
- 268
- References
- 34
- FWCI
- 34.71
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.