Helping Robots Learn: A Human-Robot Master-Apprentice Model Using Demonstrations via Virtual Reality Teleoperation
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
As artificial intelligence becomes an increasingly prevalent method of enhancing robotic capabilities, it is important to consider effective ways to train these learning pipelines and to leverage human expertise. Working towards these goals, a master-apprentice model is presented and is evaluated during a grasping task for effectiveness and human perception. The apprenticeship model augments self-supervised learning with learning by demonstration, efficiently using the human's time and expertise while facilitating future scalability to supervision of multiple robots; the human provides demonstrations via virtual reality when the robot cannot complete the task autonomously. Experimental results indicate that the robot learns a grasping task with the apprenticeship model faster than with a solely self-supervised approach and with fewer human interventions than a solely demonstration-based approach; 100% grasping success is obtained after 150 grasps with 19 demonstrations. Preliminary user studies evaluating workload, usability, and effectiveness of the system yield promising results for system scalability and deployability. They also suggest a tendency for users to overestimate the robot's skill and to generalize its capabilities, especially as learning improves.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Data-Driven Grasp Synthesis—A Survey
Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2289018 · Cited by 929
Human Performance Issues and User Interface Design for Teleoperated Robots
Chen, J. Y. C., Haas, E. C., & Barnes, M. J. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.905819 · Cited by 646 · cited 1×
“Finally, the impact of autonomy levels on human workload has been investigated in teleoperation contexts [45], [46].”
BackgroundOvertrust of robots in emergency evacuation scenarios
Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451740 · Cited by 468 · cited 1×
“dencies of users to over-trust a supervised automation and inappropriately rely on it in multi-tasking scenarios [40] and particularly with embodied robots [41].”
BackgroundThe benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“It has been observed that automation must maintain at least a 70% success level to maintain user trust [43], and that imperfect automation can still be beneficial [44].”
Backgroundde Visser, E., & Parasuraman, R. (2011) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411410160 · Cited by 207 · cited 1×
“It has been observed that automation must maintain at least a 70% success level to maintain user trust [43], and that imperfect automation can still be beneficial [44].”
BackgroundLearning force control policies for compliant manipulation
Kalakrishnan, M., Righetti, L., Pastor, P., & Schaal, S. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6095096 · Cited by 161 · cited 1×
“Policy search methods [14] can thereby enable learning new behavior from experience [15], [16], [14] or even jointly training perception and control systems [17].”
BackgroundRobot confidence and trust alignment
Kaniarasu, P., Steinfeld, A., Desai, M., & Yanco, H. (2013) · 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483548 · Cited by 34 · cited 1×
“For example, a phase delay between changes in the system’s internal prediction confidences and changes in the human collaborator’s confidence in the system have been observed in navigational tasks [39].”
Background
Cited by
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks
Li, C., Xia, F., Martín-Martín, R., Lingelbach, M., Srivastava, S., Shen, B., Vainio, K., Gokmen, C., Dharan, G., Jain, T., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.03272 · Cited by 58
“Simulation environments with virtual reality interfaces: Researchers have used virtual reality 119 interfaces before to develop robotic solutions, by using VR to teleoperate real robots [28, 29, 30].”
Human-in-the-Loop Imitation Learning using Remote Teleoperation
Mandlekar, A., Xu, D., Martín-Martín, R., Zhu, Y., Fei-Fei, L., & Savarese, S. (2020) · arXiv · doi:10.48550/arxiv.2012.06733 · Cited by 35
“While similar systems have been built recently [4, 13], our system is the only one allowing for remote web-based operation and the only one demonstrated on contact-rich manipulation tasks.”
BackgroundError-Aware Imitation Learning from Teleoperation Data for Mobile Manipulation
Wong, J., Tung, A., Kurenkov, A., Mandlekar, A., Fei-Fei, L., Savarese, S., & Martín-Martín, R. (2021) · arXiv · doi:10.48550/arxiv.2112.05251 · Cited by 19
“problem has explored using online click-through interfaces [18, 19, 20], muscle signals [21, 22], joysticks [23, 24, 25], tablets [26], and virtual reality interfaces [27, 28, 29, 30, 31, 32, 33, 34].”
Background
Metadata
- Authors
- DelPreto, J., Lipton, J. I., Sanneman, L., Fay, A. J., Fourie, C., Choi, C., & Rus, D.
- Venue
- 2020 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2020-05
- Pages
- 10226-10233
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W3091686107
- Cited by
- 41
- References
- 10
- FWCI
- 8.25
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.