The DOI matches its Crossref record.
Human-Machine Interface for Remote Training of Robot Tasks
Open accessAbstract
Regardless of their industrial or research application, the streamlining of robot operations is limited by the proximity of experienced users to the actual hardware. Be it massive open online robotics courses, crowd-sourcing of robot task training, or remote research on massive robot farms for machine learning, the need to create an apt remote Human-Machine Interface is quite prevalent. The paper at hand proposes a novel solution to the programming/training of remote robots employing an intuitive and accurate user-interface which offers all the benefits of working with real robots without imposing delays and inefficiency. The system includes: a vision-based 3D hand detection and gesture recognition subsystem, a simulated digital twin of a robot as visual feedback, and the “remote” robot learning/executing trajectories using dynamic motion primitives. Our results indicate that the system is a promising solution to the problem of remote training of robot tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the reviewed articles, DT was considered helpful for safety reasons in human-robot interaction, monitoring of smart wearable equipment, manufacturing of a produced part, VR visualization platform creation, and HMI visualization environments.
“- 6) DT was also considered helpful for 'Safety reasons' in human-robot interaction [61,63,64], in monitoring of a smart wearable equipment [67], or in the manufacturing process of a produced part [66], within a virtual reality (VR) visualization platform creation [65] or with a HMI visualization environment [60].”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [66]
Five reviewed articles use a 3D dynamical Finite Element Method (FEM)-based model.
“Five articles use a 3D dynamical Finite Element Method (FEM)-based model [32,34,38,55,66]”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [66]
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 31
- quigley, 2009, Ros: an open-source robot operating system, ICRA Workshop on Open Source Software, 3, 2
- 10.1109/MRA.2011.943230 · DOI
- 10.1109/WF-IoT.2014.6803110 · DOI
- 10.1016/S1364-6613(99)01327-3 · DOI
- 10.1016/j.robot.2004.03.001 · DOI
- 10.1109/ROBOT.2002.1014739 · DOI
- 10.1098/rstb.2002.1258 · DOI
- 10.1109/IROS.2016.7759116 · DOI
- 10.1109/IROS.2017.8206344 · DOI
- amanatiadis, 2015, Accelerating singleimage super-resolution polynomial regression in mobile devices, Robots and Systems (IROS) 2016 IEEE/RSJ International Conference on, 61, 63
- 10.1109/ReCoSoC.2011.5981524 · DOI
- boukas, 2014, An intelligent tool for the automated evaluation of pedestrian simulation, Artificial Intelligence Methods and Applications, 136, 10.1007/978-3-319-07064-3_12 · DOI
- 10.1080/01969722.2016.1154771 · DOI
- zabulis, 2009, Vision-based hand gesture recognition for human-computer interaction, The Universal Access Handbook, 34, 30
- 10.1109/SSRR.2012.6523901 · DOI
- oberweger, 2015, Hands deep in deep learning for hand pose estimation, arXiv preprint arXiv 1502 00254
- amanatiadis, 2013, A multi-objective exploration strategy for mobile robots under operational constraints, 1, 691
- 10.1109/TSSC.1968.300136 · DOI · Paper page
- yuan, 2018, Depth-based 3d hand pose estimation: From current achievements to future goals, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 10.1109/ROBOT.1985.1087297 · DOI
- 10.1109/ACCESS.2014.2302442 · DOI
- 10.1109/ROBOT.1994.351061 · DOI · Paper page
- kostavelis, 2012, Path tracing on polar depth maps for robot navigation, Cellular Automata, 395, 10.1007/978-3-642-33350-7_41 · DOI
- 10.1007/978-3-319-40379-3_26 · DOI
- 10.1109/TIE.2016.2590380 · DOI
- furukawa, 2010, Dense 3d motion capture from synchronized video streams, Image and Geometry Processing for 3-D Cinematography, 193, 10.1007/978-3-642-12392-4_9 · DOI
- 10.1088/0957-0233/22/11/114025 · DOI
- panteleris, 2017, Using a single rgb frame for real time 3d hand pose estimation in the wild, arXiv preprint arXiv 1712 03866
- 10.1016/j.patcog.2018.02.001 · DOI
- 10.1109/CVPR.2017.602 · DOI
- 10.1109/CVPRW.2015.7301343 · DOI
Cited by
Sorted by citations
Review of digital twin applications in manufacturing
Cimino, C., Negri, E., & Fumagalli, L. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.103130 · Cited by 874
Affordances from Human Videos as a Versatile Representation for Robotics
Bahl, S., Mendonca, R., Chen, L., Jain, U., & Pathak, D. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01324 · Cited by 119
“Extensive work has been done on Learning from Demonstrations (LfD) where human supervision is usually provided through teleoperation (of a joystick or VR interface) [77, 115, 133] or kinesthetic teaching, where a user physically moves the robot arm [13, 16, 27, 70, 94].”
Background
Metadata
- Authors
- Spranger, J., Buzatoiu, R., Polydoros, A., Nalpantidis, L., & Boukas, E.
- Affiliations
- Aalborg University (DK)
- Universität Innsbruck (AT)
- Venue
- 2018 IEEE International Conference on Imaging Systems and Techniques (IST)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 1-5
- OpenAlex
- W2893282623
- Cited by
- 10
- References
- 0
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 3 · 2020: 2 · 2019: 2
- FWCI
- 2.70
- Type
- conference paper
- Language
- en
- Open access
- green
- www.scopus.com
- Locations
- IEEE International Conference on Imaging Systems and Techniques (IST) (publishedVersion)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- human-machine interaction, gesture recognition, digital twin, dynamic motion primitives, vision-based interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review