CoChat
Sign Up
PreprintCited by 4Robot Manipulation and LearningReinforcement Learning in RoboticsAI-based Problem Solving and Planning

Where To Start? Transferring Simple Skills to Complex Environments

Open access
Vosylius, Vitalis, Johns, Edward·2022·arXiv
DOI 10.48550/arxiv.2212.06111arXiv 2212.06111
Open this paper in CoChat — free accountOpen PDF

Abstract

Robot learning provides a number of ways to teach robots simple skills, such as grasping. However, these skills are usually trained in open, clutter-free environments, and therefore would likely cause undesirable collisions in more complex, cluttered environments. In this work, we introduce an affordance model based on a graph representation of an environment, which is optimised during deployment to find suitable robot configurations to start a skill from, such that the skill can be executed without any collisions. We demonstrate that our method can generalise a priori acquired skills to previously unseen cluttered and constrained environments, in simulation and in the real world, for both a grasping and a placing task.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2212.06111

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Replay-based imitation learning methods are promising for learning manipulation tasks using a handful of demonstrations.

    “Replay-based imitation learning methods are promising for learning manipulation tasks using a handful of demonstrations [8-11, 46-48]”

    From MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations (2023) · cites this paper as [46]

    The Experimental Setup (p. 5) describes learning grasping and placing skills through behavioural cloning, supporting the imitation-learning and manipulation portions of the claim. It does not describe the method as replay-based, and Appendix A.1 (p. 12) says each policy used 1,000 expert demonstrations, not a handful. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

  • Several recent works learn policies using only a handful of demonstrations by replaying demonstrations in new scenes.

    “Several recent works learn policies using only a handful of demonstrations by replaying the demonstrations in new scenes [8-11, 46-48].”

    From MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations (2023) · cites this paper as [46]

    A.1 Training Data (p. 12) says the paper learns skills from expert demonstrations, but it uses 1,000 demonstrations for each policy, not a handful. Section 3.2.2 (p. 4) says it rolls out the learned skills in new simulated scenes to train another network; it does not say it replays the demonstrations there. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 48

  1. [1][1] E. Johns. Coarse-to-fine imitation learning: Robot manipulation from a single demonstration. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 46134619. IEEE, 2021. -
  2. [2][2] S. Gu, E. Holly, T. Lillicrap, and S. Levine. Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates. In 2017 IEEE international conference on robotics and automation (ICRA) , pages 3389-3396. IEEE, 2017. -
  3. [3][3] J. J. Gibson. The theory of affordances. Hilldale, USA , 1(2):67-82, 1977. -
  4. [4][4] X. Lou, Y. Yang, and C. Choi. Collision-aware target-driven object grasping in constrained environments. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 6364-6370. IEEE, 2021. -
  5. [5][5] X. Chen, K. Zheng, Z. Zeng, S. Basu, J. Cooney, J. Pavlasek, and O. C. Jenkins. Manipulationoriented object perception in clutter through affordance coordinate frames. arXiv preprint arXiv:2010.08202 , 2020. - · arXiv
  6. [6][6] M. Sundermeyer, A. Mousavian, R. Triebel, and D. Fox. Contact-graspnet: Efficient 6-dof grasp generation in cluttered scenes. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 13438-13444. IEEE, 2021. -
  7. [7][7] Y. Li, T. Kong, R. Chu, Y. Li, P. Wang, and L. Li. Simultaneous semantic and collision learning for 6-dof grasp pose estimation. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 3571-3578. IEEE, 2021. -
  8. [8][8] M. Breyer, J. J. Chung, L. Ott, R. Siegwart, and J. Nieto. Volumetric grasping network: Realtime 6 dof grasp detection in clutter. arXiv preprint arXiv:2101.01132 , 2021. - · arXiv
  9. [9][9] L. Wang, X. Meng, Y. Xiang, and D. Fox. Hierarchical policies for cluttered-scene grasping with latent plans. IEEE Robotics and Automation Letters , 2022. -
  10. [10][10] D. Driess, J.-S. Ha, M. Toussaint, and R. Tedrake. Learning models as functionals of signeddistance fields for manipulation planning. In Conference on Robot Learning , pages 245-255. PMLR, 2022. -
  11. [11][11] M. Van der Merwe, Q. Lu, B. Sundaralingam, M. Matak, and T. Hermans. Learning continuous 3d reconstructions for geometrically aware grasping. In 2020 IEEE International Conference on Robotics and Automation (ICRA) , pages 11516-11522. IEEE, 2020. -
  12. [12][12] P. Florence, C. Lynch, A. Zeng, O. A. Ramirez, A. Wahid, L. Downs, A. Wong, J. Lee, I. Mordatch, and J. Tompson. Implicit behavioral cloning. In Conference on Robot Learning , pages 158-168. PMLR, 2022. -
  13. [13][13] A. Ganapathi, P. Florence, J. Varley, K. Burns, K. Goldberg, and A. Zeng. Implicit kinematic policies: Unifying joint and cartesian action spaces in end-to-end robot learning. arXiv preprint arXiv:2203.01983 , 2022. - · arXiv
  14. [14][14] Q. Lu, K. Chenna, B. Sundaralingam, and T. Hermans. Planning multi-fingered grasps as probabilistic inference in a learned deep network. In Robotics Research , pages 455-472. Springer, 2020. -
  15. [15][15] Q. Lu and T. Hermans. Modeling grasp type improves learning-based grasp planning. IEEE Robotics and Automation Letters , 4(2):784-791, 2019. -
  16. [16][16] J.-S. Ha, D. Driess, and M. Toussaint. Learning neural implicit functions as object representations for robotic manipulation. arXiv preprint arXiv:2112.04812 , 2021. - · arXiv
  17. [17][17] W. Gao and R. Tedrake. kpam 2.0: Feedback control for category-level robotic manipulation. IEEE Robotics and Automation Letters , 6(2):2962-2969, 2021. -
  18. [18][18] L. Manuelli, Y. Li, P. Florence, and R. Tedrake. Keypoints into the future: Self-supervised correspondence in model-based reinforcement learning. arXiv preprint arXiv:2009.05085 , 2020. - · arXiv
  19. [19][19] Z. Qin, K. Fang, Y. Zhu, L. Fei-Fei, and S. Savarese. Keto: Learning keypoint representations for tool manipulation. In 2020 IEEE International Conference on Robotics and Automation (ICRA) , pages 7278-7285. IEEE, 2020. -
  20. [20][20] P. R. Florence, L. Manuelli, and R. Tedrake. Dense object nets: Learning dense visual object descriptors by and for robotic manipulation. arXiv preprint arXiv:1806.08756 , 2018. - · arXiv
  21. [21][21] P. Florence, L. Manuelli, and R. Tedrake. Self-supervised correspondence in visuomotor policy learning. IEEE Robotics and Automation Letters , 5(2):492-499, 2019. -
  22. [22][22] I. Kapelyukh and E. Johns. My house, my rules: Learning tidying preferences with graph neural networks. In Conference on Robot Learning , pages 740-749. PMLR, 2022. -
  23. [23][23] Y. Lin, A. S. Wang, E. Undersander, and A. Rai. Efficient and interpretable robot manipulation with graph neural networks. IEEE Robotics and Automation Letters , 2022. -
  24. [24][24] Y. Zhu, J. Tremblay, S. Birchfield, and Y. Zhu. Hierarchical planning for long-horizon manipulation with geometric and symbolic scene graphs. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 6541-6548. IEEE, 2021. -
  25. [25][25] B. Hu, Z. Zhang, C. Shi, J. Zhou, X. Li, and Y. Qi. Cash-out user detection based on attributed heterogeneous information network with a hierarchical attention mechanism. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 33, pages 946-953, 2019. -
  26. [26][26] H. Linmei, T. Yang, C. Shi, H. Ji, and X. Li. Heterogeneous graph attention networks for semi-supervised short text classification. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , pages 4821-4830, 2019. -
  27. [27][27] W. Hu, M. Fey, M. Zitnik, Y. Dong, H. Ren, B. Liu, M. Catasta, and J. Leskovec. Open graph benchmark: Datasets for machine learning on graphs. Advances in neural information processing systems , 33:22118-22133, 2020. -
  28. [28][28] W. Hu, M. Fey, H. Ren, M. Nakata, Y. Dong, and J. Leskovec. Ogb-lsc: A large-scale challenge for machine learning on graphs. arXiv preprint arXiv:2103.09430 , 2021. - · arXiv
  29. [29][29] C. Shi, B. Hu, W. X. Zhao, and S. Y. Philip. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering , 31(2):357370, 2018. -
  30. [30][30] B. Hu, C. Shi, W. X. Zhao, and P. S. Yu. Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , pages 1531-1540, 2018. -
  31. [31][31] B. Shi, J. Yang, T. Weninger, J. How, and Q. He. Representation learning in heterogeneous professional social networks with ambiguous social connections. In 2019 IEEE International Conference on Big Data (Big Data) , pages 1928-1937. IEEE, 2019. -
  32. [32][32] X. Wang, D. Bo, C. Shi, S. Fan, Y. Ye, and S. Y. Philip. A survey on heterogeneous graph embedding: methods, techniques, applications and sources. IEEE Transactions on Big Data , 2022. -
  33. [33][33] Y. Sun and J. Han. Mining heterogeneous information networks: a structural analysis approach. Acm Sigkdd Explorations Newsletter , 14(2):20-28, 2013. -
  34. [34][34] Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and S. Y. Philip. A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems , 32(1): 4-24, 2020. -
  35. [35][35] C. R. Qi, L. Yi, H. Su, and L. J. Guibas. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems , 30, 2017. -
  36. [36][36] M. S. Ahn, H. Chae, D. Noh, H. Nam, and D. Hong. Analysis and noise modeling of the intel realsense d435 for mobile robots. In 2019 16th International Conference on Ubiquitous Robots (UR) , pages 707-711. IEEE, 2019. -
  37. [37][37] L. T. Biegler and V. M. Zavala. Large-scale nonlinear programming using ipopt: An integrating framework for enterprise-wide dynamic optimization. Computers & Chemical Engineering , 33 (3):575-582, 2009. -
  38. [38][38] J. J. Kuffner and S. M. LaValle. Rrt-connect: An efficient approach to single-query path planning. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) , volume 2, pages 995-1001. IEEE, 2000. -
  39. [39][39] A. X. Chang, T. Funkhouser, L. Guibas, P. Hanrahan, Q. Huang, Z. Li, S. Savarese, M. Savva, S. Song, H. Su, et al. Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:1512.03012 , 2015. - · arXiv
  40. [41][41] S. James, M. Freese, and A. J. Davison. Pyrep: Bringing v-rep to deep robot learning. arXiv preprint arXiv:1906.11176 , 2019. - · arXiv
  41. [42][42] K. Sohn, H. Lee, and X. Yan. Learning structured output representation using deep conditional generative models. Advances in neural information processing systems , 28:3483-3491, 2015. -
  42. [43][43] Y. Xiang, C. Xie, A. Mousavian, and D. Fox. Learning rgb-d feature embeddings for unseen object instance segmentation. arXiv preprint arXiv:2007.15157 , 2020. - · arXiv
  43. [44][44] C. Eppner, A. Mousavian, and D. Fox. Acronym: A large-scale grasp dataset based on simulation. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 6222-6227. IEEE, 2021. -
  44. [45][45] Y. Labb´ e, J. Carpentier, M. Aubry, and J. Sivic. Cosypose: Consistent multi-view multi-object 6d pose estimation. In European Conference on Computer Vision , pages 574-591. Springer, 2020. -
  45. [46][46] D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 , 2014. - · arXiv
  46. [47][47] S. Brody, U. Alon, and E. Yahav. How attentive are graph attention networks? arXiv preprint arXiv:2105.14491 , 2021. - · arXiv
  47. [48][48] M. Fey and J. E. Lenssen. Fast graph representation learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds , 2019. -
  48. [49][49] Y. Li, D. Tarlow, M. Brockschmidt, and R. Zemel. Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493 , 2015. · arXiv

Cited by

Sorted by citations

Related

Authors
Vosylius, V., & Johns, E.
Affiliations
Imperial College London (GB)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2212.06111
arXiv
2212.06111
OpenAlex
W4311432377
Cited by
2
References
0
Citations by year
2024: 1 · 2023: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-nc-sa/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
robot learning, skill transfer, collision avoidance, cluttered environments, constrained environments, grasping

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review