CoChat
Sign Up
PreprintCited by 20Reinforcement Learning in RoboticsRobot Manipulation and LearningRobotics and Sensor-Based Localization

Error-Aware Imitation Learning from Teleoperation Data for Mobile Manipulation

Open access
Wong, Josiah, Tung, Albert, Kurenkov, Andrey, Mandlekar, Ajay, Fei-Fei, Li, Savarese, Silvio, Martín-Martín, Roberto·2021·arXiv
DOI 10.48550/arxiv.2112.05251arXiv 2112.05251
Open this paper in CoChat — free accountOpen PDF

Abstract

In mobile manipulation (MM), robots can both navigate within and interact with their environment and are thus able to complete many more tasks than robots only capable of navigation or manipulation. In this work, we explore how to apply imitation learning (IL) to learn continuous visuo-motor policies for MM tasks. Much prior work has shown that IL can train visuo-motor policies for either manipulation or navigation domains, but few works have applied IL to the MM domain. Doing this is challenging for two reasons: on the data side, current interfaces make collecting high-quality human demonstrations difficult, and on the learning side, policies trained on limited data can suffer from covariate shift when deployed. To address these problems, we first propose Mobile Manipulation RoboTurk (MoMaRT), a novel teleoperation framework allowing simultaneous navigation and manipulation of mobile manipulators, and collect a first-of-its-kind large scale dataset in a realistic simulated kitchen setting. We then propose a learned error detection system to address the covariate shift by detecting when an agent is in a potential failure state. We train performant IL policies and error detectors from this data, and achieve over 45% task success rate and 85% error detection success rate across multiple multi-stage tasks when trained on expert data. Codebase, datasets, visualization, and more available at https://sites.google.com/view/il-for-mm/home.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2112.05251

Cites

38 of 39 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • RoboTurk is a system for crowdsourcing task demonstrations from human operators using smartphone-based teleoperation and video streams provided in web browsers.

    “RoboTurk [2,23-26] is a system for crowdsourcing task demonstrations from human operators using smartphone-based teleoperation and video streams provided in web browsers.”

    From MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations (2023) · cites this paper as [26]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 40 references couldn’t be matched to a known paper.

Research works printed but not linked: 24

  1. [1][1] B. Siciliano and O. Khatib. Springer handbook of robotics . springer, 2016. -
  2. [11][11] A. Billard, S. Calinon, R. Dillmann, and S. Schaal. Robot programming by demonstration. In Springer Handbook of Robotics , 2008. -
  3. [14][14] A. Hussein, E. Elyan, M. M. Gaber, and C. Jayne. Deep imitation learning for 3d navigation tasks. Neural computing and applications , 29(7):389-404, 2018. -
  4. [16][16] J. Xu, Q. Liu, H. Guo, A. Kageza, S. AlQarni, and S. Wu. Shared multi-task imitation learning for indoor self-navigation. In 2018 IEEE Global Communications Conference (GLOBECOM) , pages 1-7. IEEE, 2018. -
  5. [17][17] H. Karnan, G. Warnell, X. Xiao, and P. Stone. Voila: Visual-observation-only imitation learning for autonomous navigation. arXiv preprint arXiv:2105.09371 , 2021. - · arXiv
  6. [19][19] V. Annem, P. Rajendran, S. Thakar, and S. K. Gupta. Towards remote teleoperation of a semiautonomous mobile manipulator system in machine tending tasks. In International Manufacturing Science and Engineering Conference , volume 58745, page V001T02A027. American Society of Mechanical Engineers, 2019. -
  7. [21][21] B. Wang, Z. Li, W. Ye, and Q. Xie. Development of human-machine interface for teleoperation of a mobile manipulator. International Journal of Control, Automation and Systems , 10(6): 1225-1231, 2012. -
  8. [27][27] A. U. Krishnan. Nursing Robot Teleoperation via Motion Mapping Interfaces . PhD thesis, WORCESTER POLYTECHNIC INSTITUTE, 2020. -
  9. [28][28] C. Gan, J. Schwartz, S. Alter, M. Schrimpf, J. Traer, J. De Freitas, J. Kubilius, A. Bhandwaldar, N. Haber, M. Sano, et al. Threedworld: A platform for interactive multi-modal physical simulation. arXiv preprint arXiv:2007.04954 , 2020. - · arXiv
  10. [32][32] X. Gao, R. Gong, T. Shu, X. Xie, S. Wang, and S.-C. Zhu. Vrkitchen: an interactive 3d virtual environment for task-oriented learning. arXiv preprint arXiv:1903.05757 , 2019. - · arXiv
  11. [34][34] T. Zhang, Z. McCarthy, O. Jow, D. Lee, K. Goldberg, and P. Abbeel. Deep imitation learning for complex manipulation tasks from virtual reality teleoperation. arXiv preprint arXiv:1710.04615 , 2017. - · arXiv
  12. [37][37] K. Nagatani and S. Yuta. Designing strategy and implementation of mobile manipulator control system for opening door. In Proceedings of IEEE International Conference on Robotics and Automation , volume 3, pages 2828-2834. IEEE, 1996. -
  13. [40][40] D. Honerkamp, T. Welschehold, and A. Valada. Learning kinematic feasibility for mobile manipulation through deep reinforcement learning. arXiv preprint arXiv:2101.05325 , 2021. - · arXiv
  14. [42][42] C. R. Garrett, T. Lozano-Perez, and L. P. Kaelbling. Ffrob: Leveraging symbolic planning for efficient task and motion planning. The International Journal of Robotics Research , 37(1): 104-136, 2018. -
  15. [46][46] C. Li, F. Xia, R. Mart´ ın-Mart´ ın, and S. Savarese. Hrl4in: Hierarchical reinforcement learning for interactive navigation with mobile manipulators. In Conference on Robot Learning , pages 603-616. PMLR, 2020. -
  16. [48][48] R. Chalapathy and S. Chawla. Deep learning for anomaly detection: A survey. arXiv preprint arXiv:1901.03407 , 2019. - · arXiv
  17. [50][50] G. Kahn, A. Villaflor, V. Pong, P. Abbeel, and S. Levine. Uncertainty-aware reinforcement learning for collision avoidance. arXiv preprint arXiv:1702.01182 , 2017. - · arXiv
  18. [51][51] A. Filos, P. Tigas, R. McAllister, N. Rhinehart, S. Levine, and Y . Gal. Can autonomous vehicles identify, recover from, and adapt to distribution shifts? arXiv preprint arXiv:2006.14911 , 2020. - · arXiv
  19. [56][56] M. A. Lee, M. Tan, Y. Zhu, and J. Bohg. Detect, reject, correct: Crossmodal compensation of corrupted sensors. arXiv preprint arXiv:2012.00201 , 2020. - · arXiv
  20. [57][57] A. Mandlekar, J. Booher, M. Spero, A. Tung, A. Gupta, Y. Zhu, A. Garg, S. Savarese, and L. Fei-Fei. Scaling robot supervision to hundreds of hours with roboturk: Robotic manipulation dataset through human reasoning and dexterity. arXiv preprint arXiv:1911.04052 , 2019. - · arXiv
  21. [58][58] A. Mandlekar, D. Xu, R. Mart´ ın-Mart´ ın, S. Savarese, and L. Fei-Fei. Learning to generalize across long-horizon tasks from human demonstrations. arXiv preprint arXiv:2003.06085 , 2020. - · arXiv
  22. [61][61] F. Xia, W. B. Shen, C. Li, P. Kasimbeg, M. E. Tchapmi, A. Toshev, R. Mart´ ın-Mart´ ın, and S. Savarese. Interactive gibson benchmark: A benchmark for interactive navigation in cluttered environments. IEEE Robotics and Automation Letters , 5(2):713-720, 2020. -
  23. [62][62] B. Shen, F. Xia, C. Li, R. Mart´ ın-Mart´ ın, L. Fan, G. Wang, S. Buch, C. D'Arpino, S. Srivastava, L. P. Tchapmi, et al. igibson, a simulation environment for interactive tasks in large realisticscenes. arXiv preprint arXiv:2012.02924 , 2020. - · arXiv
  24. [67][67] D. P. Kingma and M. Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 , 2013. · arXiv

Cited by

Sorted by citations

Related

Authors
Wong, J., Tung, A., Kurenkov, A., Mandlekar, A., Fei-Fei, L., Savarese, S., & Martín-Martín, R.
Affiliations
Stanford University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2112.05251
arXiv
2112.05251
OpenAlex
W3211283137
Cited by
19
References
40
Citations by year
2025: 1 · 2024: 11 · 2023: 6 · 2022: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
Keywords
mobile manipulation, imitation learning, teleoperation, error detection, covariate shift, human demonstrations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review