PreprintCited by 50Robot Manipulation and LearningTeleoperation and Haptic SystemsReinforcement Learning in Robotics

Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

Open access
Mandlekar, Ajay, Booher, Jonathan, Spero, Max, Tung, Albert, Gupta, Anchit, Zhu, Yuke, Garg, Animesh, Savarese, Silvio +1 more·2019·arXiv

Abstract

Large, richly annotated datasets have accelerated progress in fields such as computer vision and natural language processing, but replicating these successes in robotics has been challenging. While prior data collection methodologies such as self-supervision have resulted in large datasets, the data can have poor signal-to-noise ratio. By contrast, previous efforts to collect task demonstrations with humans provide better quality data, but they cannot reach the same data magnitude. Furthermore, neither approach places guarantees on the diversity of the data collected, in terms of solution strategies. In this work, we leverage and extend the RoboTurk platform to scale up data collection for robotic manipulation using remote teleoperation. The primary motivation for our platform is two-fold: (1) to address the shortcomings of prior work and increase the total quantity of manipulation data collected through human supervision by an order of magnitude without sacrificing the quality of the data and (2) to collect data on challenging manipulation tasks across several operators and observe a diverse set of emergent behaviors and solutions. We collected over 111 hours of robot manipulation data across 54 users and 3 challenging manipulation tasks in 1 week, resulting in the largest robot dataset collected via remote teleoperation. We evaluate the quality of our platform, the diversity of demonstrations in our dataset, and the utility of our dataset via quantitative and qualitative analysis. For additional results, supplementary videos, and to download our dataset, visit http://roboturk.stanford.edu/realrobotdataset .

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1911.04052

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • RoboTurk is a system for crowdsourcing task demonstrations from human operators using smartphone-based teleoperation and video streams provided in web browsers.

    “RoboTurk [2,23-26] is a system for crowdsourcing task demonstrations from human operators using smartphone-based teleoperation and video streams provided in web browsers.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

3 of the 44 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. M. Danielczuk, A. Kurenkov, A. Balakrishna, M. Matl, R. Martín- Martín, A. Garg, S. Savarese, and K. Goldberg, "Mechanical search: Learning manipulation strategies to extract a specific object from a bin of unknown objects", The 2019 International Conference on Robotics and Automation (ICRA), 2019.
  2. K. Goldberg, "Beyond the web: Excavating the real world via mosaic", in Second International WWW Conference, 1994.

Cited by

Sorted by citations

Authors
Mandlekar, A., Booher, J., Spero, M., Tung, A., Gupta, A., Zhu, Y., Garg, A., Savarese, S., & Fei-Fei, L.
Affiliations
  • Stanford University (US)
  • Nvidia (United States) (US)
Venue
arXiv
Publisher
arXiv
Published
2019
Pages
1048-1055
ISSN
2153-0858 (ISSN-L)
OpenAlex
W3003310656
Cited by
48
References
44
Citations by year
2026: 1 · 2025: 13 · 2024: 7 · 2023: 8 · 2022: 4 · 2021: 10 · 2020: 5
FWCI
7.35
Type
conference paper
Language
en
Open access
Locations
  • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • U.S. Department of Defense
  • Nvidia
  • Toyota Research Institute
  • National Defense Science and Engineering Graduate
  • Multidisciplinary University Research Initiative
  • Office of Naval Research
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review