The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards
Abstract
This paper presents the Dexterity Network (Dex-Net) 1.0, a dataset of 3D object models and a sampling-based planning algorithm to explore how Cloud Robotics can be used for robust grasp planning. The algorithm uses a Multi- Armed Bandit model with correlated rewards to leverage prior grasps and 3D object models in a growing dataset that currently includes over 10,000 unique 3D object models and 2.5 million parallel-jaw grasps. Each grasp includes an estimate of the probability of force closure under uncertainty in object and gripper pose and friction. Dex-Net 1.0 uses Multi-View Convolutional Neural Networks (MV-CNNs), a new deep learning method for 3D object classification, to provide a similarity metric between objects, and the Google Cloud Platform to simultaneously run up to 1,500 virtual cores, reducing experiment runtime by up to three orders of magnitude. Experiments suggest that correlated bandit techniques can use a cloud-based network of object models to significantly reduce the number of samples required for robust grasp planning. We report on system sensitivity to variations in similarity metrics and in uncertainty in pose and friction. Code and updated information is available at http://berkeleyautomation.github.io/dex-net/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Multi-view Convolutional Neural Networks for 3D Shape Recognition
Su, H., Maji, S., Kalogerakis, E., & Learned-Miller, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.114 · Cited by 3,480
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,634
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
SHOT: Unique signatures of histograms for surface and texture description
Salti, S., Tombari, F., & Di Stefano, L. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.04.011 · Cited by 987
Data-Driven Grasp Synthesis—A Survey
Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2289018 · Cited by 929
A Survey of Research on Cloud Robotics and Automation
Kehoe, B., Patil, S., Abbeel, P., & Goldberg, K. (2015) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2376492 · Cited by 833
Self-citationShape google: Geometric words and expressions for invariant shape retrieval
Bronstein, A. M., Bronstein, M. M., Guibas, L. J., & Ovsjanikov, M. (2011) · ACM Transactions on Graphics · doi:10.1145/1899404.1899405 · Cited by 810
1Data-Driven Grasp Synthesis- A SurveyPreprint
Bohg, J., Morales, A., Asfour, T., & Kragić, D. (2014) · Cited by 532
BigBIRD: A large-scale 3D database of object instances
Singh, A., Sha, J., Narayan, K. S., Achim, T., & Abbeel, P. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906903 · Cited by 311
Goldfeder, C., Ciocarlie, M., Dang, H., & Allen, P. K. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152709 · Cited by 309
Associating Uncertainty With Three-Dimensional Poses for Use in Estimation Problems
Barfoot, T. D., & Furgale, P. T. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2298059 · Cited by 305
Leveraging big data for grasp planning
Kappler, D., Bohg, J., & Schaal, S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139793 · Cited by 268
Cloud-based robot grasping with the google object recognition engine
Kehoe, B., Matsukawa, A., Candido, S., Kuffner, J., & Goldberg, K. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6631180 · Cited by 228
Self-citationKasper, A., Xue, Z., & Dillmann, R. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912445831 · Cited by 228
Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocols
Çallı, B., Walsman, A., Singh, A., Srinivasa, S. S., Abbeel, P., & Dollar, A. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.03143 · Cited by 203
Pose error robust grasping from contact wrench space metrics
Weisz, J., & Allen, P. K. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224697 · Cited by 171
Combining active learning and reactive control for robot grasping
Kroemer, O., Detry, R. J., Piater, J., & Peters, J. (2010) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2010.06.001 · Cited by 152
3DNet: Large-scale object class recognition from CAD models
Wohlkinger, W., Aldomà, A., Rusu, R. B., & Vincze, M. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225116 · Cited by 143
Understanding Deep Features with Computer-Generated Imagery
Aubry, M., & Russell, B. C. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.329 · Cited by 137
Self-citationLi, B., Lu, Y., Li, C., Godil, A., Schreck, T., Aono, M., Burtscher, M., Chen, Q., Chowdhury, N. K., Fang, B., et al. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.10.006 · Cited by 124
Goldfeder, C., & Allen, P. K. (2011) · Autonomous Robots · doi:10.1007/s10514-011-9228-1 · Cited by 120
Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps
Balasubramanian, R., Xu, L., Brook, P. D., Smith, J. R., & Matsuoka, Y. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2189498 · Cited by 116
Learning of grasp selection based on shape-templates
Herzog, A., Pástor, P., Kalakrishnan, M., Righetti, L., Bohg, J., Asfour, T., & Schaal, S. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9366-8 · Cited by 112
Learning a dictionary of prototypical grasp-predicting parts from grasping experience
Detry, R. J., Ek, C. H., Madry, M., & Kragić, D. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630635 · Cited by 98
Learning grasp affordance densities
Detry, R., Kraft, D., Kroemer, O., Bodenhagen, L., Peters, J., Krüger, N., & Piater, J. (2011) · Paladyn Journal of Behavioral Robotics · doi:10.2478/s13230-011-0012-x · Cited by 79
Physically Based Grasp Quality Evaluation Under Pose Uncertainty
Kim, J.-G., Iwamoto, K., Kuffner, J., Ota, Y., & Pollard, N. S. (2013) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2273846 · Cited by 71
Self-citationKehoe, B., Berenson, D., & Goldberg, K. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224781 · Cited by 60
Self-citationCollaborative grasp planning with multiple object representations
Brook, P. D., Ciocarlie, M., & Hsiao, K. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980490 · Cited by 55
Active Learning for Vision-Based Robot Grasping
Salganicoff, M., Ungar, L., & Bajcsy, R. (1996) · Machine Learning · doi:10.1007/bf00117446 · Cited by 53
Active learning of visual descriptors for grasping using non-parametric smoothed beta distributions
Montesano, L., & Lopes, M. C. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.013 · Cited by 40
Multi-armed bandit models for 2D grasp planning with uncertainty
Laskey, M., Mahler, J., McCarthy, Z., Pokorny, F. T., Patil, S., van den Berg, J., Kragić, D., Abbeel, P., & Goldberg, K. (2015) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2015.7294140 · Cited by 35
Self-citationAutonomously Acquiring Instance-Based Object Models from Experience
Oberlin, J., & Tellex, S. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-60916-4_5 · Cited by 21
Exploiting correlation and budget constraints in Bayesian multi-armed bandit optimizationPreprint
Hoffman, M. W., Shahriari, B., & de Freitas, N. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1303.6746 · Cited by 15
(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Cited by
Levine, S., Pastor, P., Krizhevsky, A., Ibarz, J., & Quillen, D. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917710318 · Cited by 1,971
Mahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Aparicio, J., & Goldberg, K. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.058 · Cited by 1,268
Self-citationClosing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach
Morrison, D., Leitner, J., & Corke, P. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.021 · Cited by 630
Learning ambidextrous robot grasping policies
Mahler, J., Matl, M., Satish, V., Danielczuk, M., DeRose, B., McKinley, S., & Goldberg, K. (2019) · Science Robotics · doi:10.1126/scirobotics.aau4984 · Cited by 563
Self-citationRobotic grasp detection using deep convolutional neural networks
Kumra, S., & Kanan, C. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202237 · Cited by 536
Metadata
- Authors
- Mahler, J., Pokorny, F. T., Hou, B., Roderick, M., Laskey, M., Aubry, M., Kohlhoff, K., Kroger, T., Kuffner, J., & Goldberg, K.
- Venue
- 2016 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2016-05
- Pages
- 1957-1964
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2414685554
- Cited by
- 359
- References
- 38
- FWCI
- 60.71
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.