Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 205

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-to-End Learning from Demonstration

Open access
Rahmatizadeh, Rouhollah, Abolghasemi, Pooya, Boloni, Ladislau, Levine, Sergey · 2018 · 2018 IEEE International Conference on Robotics and Automation (ICRA)

Abstract

We propose a technique for multi-task learning from demonstration that trains the controller of a low-cost robotic arm to accomplish several complex picking and placing tasks, as well as non-prehensile manipulation. The controller is a recurrent neural network using raw images as input and generating robot arm trajectories, with the parameters shared across the tasks. The controller also combines VAE-GAN-based reconstruction with autoregressive multimodal action prediction. Our results demonstrate that it is possible to learn complex manipulation tasks, such as picking up a towel, wiping an object, and depositing the towel to its previous position, entirely from raw images with direct behavior cloning. We show that weight sharing and reconstruction-based regularization substantially improve generalization and robustness, and training on multiple tasks simultaneously increases the success rate on all tasks.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/icra.2018.8461076

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 36

  1. graves, 2013, Generating Sequences with Recurrent Neural Networks
  2. mclachlan, 1988, Mixture models. inference and applications to clustering, Statistics Textbooks and Monographs, 1
  3. ba, 2016, Layer normalization
  4. goodfellow, 2014, Generative adversarial nets, Advances in neural information processing systems, 2672
  5. kingma, 2013, Auto-encoding variational bayes
  6. srivastava, 2014, Dropout: A simple way to prevent neural networks from overfitting, The Journal of Machine Learning Research, 15, 1929
  7. kingma, 2014, Semi-supervised learning with deep generative models, Advances in neural information processing systems, 3581
  8. larochelle, 2011, The neural autoregressive distribution estimator, AISTATS, 1, 2
  9. bishop, 1994, Mixture density networks, Technical Report
  10. forbes, 2014, Robot programming by demonstration with crowdsourced action fixes, Second AAAI Conference on Human Computation and Crowdsourcing
  11. sutskever, 2014, Sequence to sequence learning with neural networks, Advances in Neural Information Processing Systems (NIPS), 3104
  12. 10.1145/1957656.1957788 · DOI
  13. fang, 2016, Learning models for constraint-based motion parameterization from interactive physics-based simulation, IEEE Int Conf Intell Robots Syst (IROS), 4005
  14. 10.1016/j.neunet.2008.02.003 · DOI · Paper page
  15. 10.2174/1573399812666160613113556 · DOI · Paper page
  16. pinto, 2016, Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours, IEEE International Conference on Robotics and Automation (ICRA), 763
  17. mayer, 2006, A system for robotic heart surgery that learns to tie knots using recurrent neural networks, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 543
  18. ioffe, 2015, Batch Normalization Accelerating Deep Network Training by Reducing Internal Covariate Shift
  19. sung, 2015, Robobarista: Object part-based transfer of manipulation trajectories from crowd-sourcing in 3d point-clouds, International Symposium on Robotics Research (ISRR)
  20. rahmatizadeh, 2016, Learning real manipulation tasks from virtual demonstrations using lstm
  21. 10.1109/TRO.2015.2495003 · DOI
  22. larsen, 2016, Autoencoding beyond pixels using a learned similarity metric, International Conference on Machine Learning, 1558
  23. 10.1177/0278364915594244 · DOI
  24. lioutikov, 2016, Learning manipulation by sequencing motor primitives with a two-armed robot, Intelligent Autonomous Systems, 1601, 10.1007/978-3-319-08338-4_115 · DOI
  25. 10.1109/MRA.2010.936947 · DOI · Paper page
  26. kehoe, 2013, Cloud-based robot grasping with the Google object recognition engine, IEEE International Conference on Robotics and Automation (ICRA), 4263
  27. 10.1177/0278364910371999 · DOI · Paper page
  28. agrawal, 2016, Learning to poke by poking Experiential learning of intuitive physics
  29. bengio, 1999, Modeling high-dimensional discrete data with multi-layer neural networks, Advances in Neural Information Processing Systems (NIPS), 99, 400
  30. tieleman, 2012, Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude, COURSERA Neural Networks for Machine Learning, 4
  31. deisenroth, 2014, Multi-task policy search for robotics, IEEE International Conference on Robotics and Automation (ICRA), 3876, 10.1109/ICRA.2014.6907421 · DOI
  32. caruana, 1995, Learning many related tasks at the same time with backpropagation, Advances in neural information processing systems, 657
  33. 10.1016/0004-3702(92)90065-6 · DOI · Paper page
  34. pinto, 2016, Learning to push by grasping Using multiple tasks for effective learning
  35. oord, 2016, Pixel recurrent neural networks, International Conference on Machine Learning, 1747
  36. devin, 2016, Learning modular neural network policies for multi-task and multi-robot transfer

Cited by

See all 205

Metadata

Authors
Rahmatizadeh, R., Abolghasemi, P., Boloni, L., & Levine, S.
Venue
2018 IEEE International Conference on Robotics and Automation (ICRA)
Publisher
IEEE
Published
2018-05
Pages
3758-3765
ISSN
1050-4729 (ISSN-L)
OpenAlex
W2735668228
Cited by
205
References
9
FWCI
42.79
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-to-End Learning from Demonstration. https://app.cochat.ai/papers/10.1109/icra.2018.8461076
The paper
Rahmatizadeh, R., Abolghasemi, P., Boloni, L., & Levine, S. (2018). Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-to-End Learning from Demonstration. 2018 IEEE International Conference on Robotics and Automation (ICRA). https://doi.org/10.1109/icra.2018.8461076

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.