Remote Control Device to Drive the Arm Gestures of an Assistant Humanoid Robot
Open accessThe DOI matches its Crossref record; 75 of the 76 references it cites were found in a registry or an index.
Abstract
This work presents a remote control device designed to drive the arm gestures of an assistant humanoid mobile robot. The remote control is a master device with two passive arms configured to replicate the four degrees of freedom of each arm of the original assistant humanoid robot and send this information to the robot. This configuration allows the mobile robot to directly replicate the position of the arms on the remote controller. The objective of this proposal is to provide the robot with enhanced non-verbal and pointing communication capabilities during human interaction or assistance. The master device registers the angular position of each joint of its passive arms and transmits this information to the mobile robot, which replicates it. The experimental evaluation of the system has shown that the humanoid robot is able to successfully replicate any gesture on the remote controller. The positions of the arms have been sampled at a frame rate of 20 ms, and the average telecontrol delay obtained in the gesture experiments has been 549 ms, without appreciable jumps or irregularities in the gestures. The conclusion is that the direct manipulation of the passive arms of the remote control device provides the APR-02 humanoid robot with enhanced non-verbal and pointing communication capabilities during human interaction or assistance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All of these systems are based on rules and/or procedural generation, which limits the degree of naturalness, fluidity, and variability that can be achieved in the resulting animations, and makes it difficult to match the gesture quality produced by contemporary generative models for co-speech gestures as described above.”
From Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents (2024) · cites this paper as [24]
Citations
Cites
Lag as a determinant of human performance in interactive systems
MacKenzie, I. S., & Ware, C. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169431 · Cited by 418
Vehicle Teleoperation Interfaces
Fong, T., & Thorpe, C. (2001) · Autonomous Robots · doi:10.1023/a:1011295826834 · Cited by 406
Robot Learning from Demonstration in Robotic Assembly: A Survey
Zhu, Z., & Hu, H. (2018) · Robotics · doi:10.3390/robotics7020017 · Cited by 255
Multi-Robot Systems: From Swarms to Intelligent Automata
(2002) · Springer eBooks · doi:10.1007/978-94-017-2376-3 · Cited by 211
Teleoperation methods and enhancement techniques for mobile robots: A comprehensive survey
Moniruzzaman, M., Rassau, A., Chai, D., & Islam, S. M. S. (2022) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103973 · Cited by 177
A Literature Review on New Robotics: Automation from Love to War
Royakkers, L., & van Est, R. (2015) · International Journal of Social Robotics · doi:10.1007/s12369-015-0295-x · Cited by 170
Strategies for human-in-the-loop robotic grasping
Leeper, A. E., Hsiao, K., Ciocarlie, M., Takayama, L., & Gossow, D. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157691 · Cited by 168
Robots for humanity: using assistive robotics to empower people with disabilities
Chen, T. L., Ciocarlie, M., Cousins, S., Grice, P. M., Hawkins, K., Hsiao, K., Kemp, C. C., King, C.-H., Lazewatsky, D. A., Leeper, A. E., et al. (2013) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2229950 · Cited by 162
Real-time imitation of human whole-body motions by humanoids
Koenemann, J., Burget, F., & Bennewitz, M. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907261 · Cited by 161
Programming full-body movements for humanoid robots by observation
Ude, A., Atkeson, C. G., & Riley, M. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.004 · Cited by 160
Nakaoka, S., Nakazawa, A., Kanehiro, F., Kaneko, K., Morisawa, M., Hirukawa, H., & Ikeuchi, K. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907079430 · Cited by 153
Device-to-device communication in 5G cellular networks
Shen, X. (2015) · IEEE Network · doi:10.1109/mnet.2015.7064895 · Cited by 145
Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly
Sellner, B., Heger, F. W., Hiatt, L. M., Simmons, R., & Singh, S. (2006) · Proceedings of the IEEE · doi:10.1109/jproc.2006.876966 · Cited by 143
Human supervisory control of robot systems
Sheridan, T. B. (1986) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1986.1087506 · Cited by 142
Bekker, M. M., Olson, J. S., & Olson, G. M. (1995) · Proceedings of the conference on Designing interactive systems processes, practices, methods, & techniques - DIS '95 · doi:10.1145/225434.225452 · Cited by 130
On human motion imitation by humanoid robot
Suleiman, W., Yoshida, E., Kanehiro, F., Laumond, J.-P., & Monin, A. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543619 · Cited by 129
Motion capture based human motion recognition and imitation by direct marker control
Ott, C., Lee, D., & Nakamura, Y. (2008) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2008.4755984 · Cited by 125
M2M Communications in 5G: State-of-the-Art Architecture, Recent Advances, and Research Challenges
Mehmood, Y., Haider, N., Imran, M., Timm-Giel, A., & Guizani, M. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600559 · Cited by 115
A Review on Teleoperation of Mobile Ground Robots: Architecture and Situation Awareness
Opiyo, S., Zhou, J. C., Mwangi, E., Wang, K., & Sunusi, I. I. (2020) · International Journal of Control Automation and Systems · doi:10.1007/s12555-019-0999-z · Cited by 112
Stable whole-body motion generation for humanoid robots to imitate human motions
Kim, S., Kim, C., You, B.-J., & Oh, S. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354271 · Cited by 95
Bao, X., Guo, S., Guo, Y., Yang, C. W., Shi, L., Li, Y., & Jiang, Y. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3140887 · Cited by 95
Measuring the Feasibility of Teleoperated Driving in Mobile Networks
Neumeier, S., Walelgne, E. A., Bajpai, V., Ott, J., & Facchi, C. (2019) · 2019 Network Traffic Measurement and Analysis Conference (TMA) · doi:10.23919/tma.2019.8784466 · Cited by 88
Workspace control system of underwater tele-operated manipulators on an ROV
Shim, H., Jun, B.-H., Lee, P.-M., Baek, H., & Lee, J. (2010) · Ocean Engineering · doi:10.1016/j.oceaneng.2010.03.017 · Cited by 82
Implementation of Industry 4.0 technology: New opportunities and challenges for maintenance strategy
Bona, G. D., Cesarotti, V., Arcese, G., & Gallo, T. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.01.258 · Cited by 81
Supervised Autonomous Locomotion and Manipulation for Disaster Response with a Centaur-Like Robot
Klamt, T., Rodriguez, D., Schwarz, M., Lenz, C., Pavlichenko, D., Droeschel, D., & Behnke, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594509 · Cited by 80
Adjustable Autonomy for Human-Centered Autonomous Systems
Dorais, G. A., Pell, B., & Schreckenghost, D. L. (1999) · Cited by 77
Small Teleoperated Robot for Nuclear Radiation and Chemical Leak Detection
Qian, K., Song, A., Bao, J., & Zhang, H. (2012) · International Journal of Advanced Robotic Systems · doi:10.5772/50720 · Cited by 77
Imitation of human motion on a humanoid robot using non-linear optimization
Do, M., Azad, P., Asfour, T., & Dillmann, R. (2008) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2008.4756029 · Cited by 75
Effects of Variation in System Responsiveness on User Performance in Virtual Environments
Watson, B. A., Walker, N., Ribarsky, W., & Spaulding, V. A. (1998) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779591287 · Cited by 72
Mixed-initiative control for remote characterization of hazardous environments
Bruemmer, D. J., Marble, J. L., Dudenhoeffer, D. D., Anderson, M., & McKay, M. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2003.1174289 · Cited by 66
Controlling humanoid robots with human motion data: Experimental validation
Yamane, K., Anderson, S. O., & Hodgins, J. K. (2010) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2010.5686312 · Cited by 62
A Review on Haptic Bilateral Teleoperation Systems
Nahri, S. N. F., Du, S., & van Wyk, B. J. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01523-x · Cited by 61
A Suite of Robotic Solutions for Nuclear Waste Decommissioning
Vitanov, I., Farkhatdinov, I., Denoun, B., Palermo, F., Otaran, A., Brown, J., Omarali, B., Abrar, T., Hansard, M. E., Oh, C., et al. (2021) · Robotics · doi:10.3390/robotics10040112 · Cited by 59
ONLINE TRANSFER OF HUMAN MOTION TO HUMANOIDS
Dariush, B., Gienger, M., Arumbakkam, A., Zhu, Y., JIAN, B., Fujimura, K., & Goerick, C. (2009) · International Journal of Humanoid Robotics · doi:10.1142/s021984360900170x · Cited by 58
Review of Human–Machine Interfaces for Small Unmanned Systems With Robotic Manipulators
Young, S. N., & Peschel, J. M. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2020.2969380 · Cited by 58
Mixed reality-integrated 3D/2D vision mapping for intuitive teleoperation of mobile manipulator
Su, Y., Chen, X., Zhou, T., Pretty, C. G., & Chase, G. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2022.102332 · Cited by 58
Assistant Personal Robot (APR): Conception and Application of a Tele-Operated Assisted Living Robot
Clotet, E., Martínez, D., Moreno, J., Tresánchez, M., & Palacín, J. (2016) · Sensors · doi:10.3390/s16050610 · Cited by 55
Self-citationLearning to walk through imitation
Chalodhorn, R., Grimes, D. B., Grochow, K., & Rao, R. P. N. (2007) · International Joint Conference on Artificial Intelligence · Cited by 53
Su, Y., Chen, X., Zhou, T., Pretty, C. G., & Chase, J. G. (2022) · Applied Sciences · doi:10.3390/app12094740 · Cited by 49
Marvin: An Innovative Omni-Directional Robotic Assistant for Domestic Environments
Eirale, A., Martini, M., Tagliavini, L., Gandini, D., Chiaberge, M., & Quaglia, G. (2022) · Sensors · doi:10.3390/s22145261 · Cited by 46
Weber, B., Balachandran, R., Riecke, C., Stulp, F., & Stelzer, M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968030 · Cited by 42
Extending the Application of an Assistant Personal Robot as a Walk-Helper Tool
Palacín, J., Clotet, E., Martínez, D., Martínez, D., & Moreno, J. (2019) · Robotics · doi:10.3390/robotics8020027 · Cited by 35
Self-citationFalcone, S., Englebienne, G., van Erp, J. B. F., & Heylen, D. (2022) · Human-Computer Interaction · doi:10.1080/07370024.2022.2039147 · Cited by 35
A Review of Bilateral Teleoperation Control Strategies with Soft Environment
Deng, Y., Tang, Y., Yang, B., Zheng, W., Liu, S., & Liu, C. (2021) · International Conference on Advanced Robotics and Mechatronics (ICARM) · doi:10.1109/icarm52023.2021.9536056 · Cited by 31
Choi, J. J., Kim, Y., & Kwak, S. S. (2014) · IEEE RO-MAN · doi:10.1109/roman.2014.6926394 · Cited by 28
Palacín, J., Rubies, E., & Clotet, E. (2022) · Applied Sciences · doi:10.3390/app12052606 · Cited by 27
Self-citationMultimodal deep autoencoders for control of a mobile robot
Sergeant, J., Suenderhauf, N., Milford, M. J., & Upcroft, B. (2015) · QUT ePrints (Queensland University of Technology) · Cited by 24
Luperto, M., Romeo, M., Monroy, J., Renoux, J., Vuono, A., Moreno, F.-Á., González-Jiménez, J., Basilico, N., & Borghese, N. A. (2022) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2022.104170 · Cited by 23
Learning to generate pointing gestures in situated embodied conversational agents
Deichler, A., Wang, S., Alexanderson, S., & Beskow, J. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1110534 · Cited by 22
The Assistant Personal Robot Project: From the APR-01 to the APR-02 Mobile Robot Prototypes
Palacín, J., Rubies, E., & Clotet, E. (2022) · Designs · doi:10.3390/designs6040066 · Cited by 22
Self-citationPalacín, J., Rubies, E., Bitriá, R., & Clotet, E. (2023) · Applied Sciences · doi:10.3390/app13021053 · Cited by 21
Self-citationMotion recognition using deep convolutional neural network for Kinect-based NAO teleoperation
Balmik, A., Paikaray, A., Jha, M., & Nandy, A. (2022) · Robotica · doi:10.1017/s0263574722000169 · Cited by 19
Stahl, C., Anastasiou, D., & Latour, T. (2018) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3197768.3203180 · Cited by 18
Rubies, E., Palacín, J., & Clotet, E. (2022) · Sensors · doi:10.3390/s22114282 · Cited by 18
Self-citationOh, J., Lee, I., Jeong, H., & Oh, J.-H. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1581658 · Cited by 17
Upright and Crawling Locomotion and Its Transition for a Wheel-Legged Robot
Qiu, X., Yu, Z., Meng, L., Chen, X., Zhao, L., Huang, G., & Meng, F. (2022) · Micromachines · doi:10.3390/mi13081252 · Cited by 17
Materna, Z., Španěl, M., Mast, M., Beran, V., Weißhardt, F., Burmester, M., & Smrž, P. (2017) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2017.p0381 · Cited by 16
Anthropomorphic Grasping of Complex-Shaped Objects Using Imitation Learning
Yi, J.-B., Kim, J., Kang, T., Song, D., Park, J., & Yi, S. (2022) · Applied Sciences · doi:10.3390/app122412861 · Cited by 16
Non-Contact and Non-Intrusive Add-on IoT Device for Wireless Remote Elevator Control
Rubies, E., Bitriá, R., Clotet, E., & Palacín, J. (2023) · Applied Sciences · doi:10.3390/app13063971 · Cited by 14
Self-citationOrtíz-Torres, G., Castillo, P., & Reyes‐Reyes, J. (2018) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2018.8453288 · Cited by 13
A Novel Multi-Modal Teleoperation of a Humanoid Assistive Robot with Real-Time Motion Mimic
Cerón, J. C., Sunny, M. S. H., Brahmi, B., Moreno, L. M. M., Fareh, R., Ahmed, H. U., & Rahman, M. H. (2023) · Micromachines · doi:10.3390/mi14020461 · Cited by 11
Online Telemanipulation Framework on Humanoid for both Manipulation and Imitation
Lim, D., Kim, D., & Park, J. (2022) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur55393.2022.9826256 · Cited by 9
Evaluation of Objective Functions for the Optimal Design of an Assistive Robot
Sanjuan, J., Sunny, M. S. H., Muñoz, E., Hernandez, J., Torres, A., Brahmi, B., Wang, I., Ghommam, J., & Rahman, M. H. (2022) · Micromachines · doi:10.3390/mi13122206 · Cited by 9
A comparative study of teleoperated and autonomous task completion for sample return rover missions
Dimitrov, V. D., & Padır, T. (2014) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2014.6836304 · Cited by 7
Vozar, S., & Tilbury, D. M. (2012) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2012-70347 · Cited by 7
Robotic remote control based on human motion via virtual collaboration system: A survey
Jung, H., & Song, Y.-E. (2018) · Journal of Advanced Mechanical Design Systems and Manufacturing · doi:10.1299/jamdsm.2018jamdsm0126 · Cited by 7
Analysis of M2M capabilities in 4G
Poncela, J., Moreno, J. M., & Aamir, M. (2014) · International Conference on Wireless Communication, Vehicular Technology, Information Theory and Aerospace & Electronic Systems Technology · doi:10.1109/vitae.2014.6934424 · Cited by 6
Teleoperating Humanoids Robots using Standard VR Headsets: A Systematic Review
Spano, L. D. (2021) · International Conference on Computer-Human Interaction Research and Applications (CHIRA) · doi:10.5220/0010723200003060 · Cited by 6
Autonomous systems control aided by Virtual Teleportation of remote operator
Moczulski, W. A. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.07.583 · Cited by 5
Offline Imitation of a Human Motion by a Humanoid Robot Under Balance Constraint
Munirathinam, K., Chevallereau, C., & Sakka, S. (2014) · Mechanisms and machine science · doi:10.1007/978-3-319-05431-5_18 · Cited by 4
The architecture of the remote control system oriented to 4G networks
Lian, Y., Zhang, W., & Jiang, J. (2012) · International Conference on Consumer Electronics, Communications and Networks (CECNet) · doi:10.1109/cecnet.2012.6201863 · Cited by 4
Imitation of Human Upper-Body Motions by Humanoid Robots
Gonen, E. C., Chae, Y.-J., & Kim, C. (2019) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/urai.2019.8768597 · Cited by 4
Effective Human-Machine Interfaces for Aerial Telemanipulation
Nixon, G. (2015) · Research Repository (Delft University of Technology) · Cited by 3
Exploring current communication frameworks for medical teleoperation
Oliveira, V., Morais, P., Oliveira, B., Vilaça, J. L., & Moreira, A. H. J. (2021) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah52098.2021.9551888 · Cited by 2
Comparison of Mobile Platform Teleoperation Systems Using a Force-Torque Sensor and a Joystick
Pawlowski, A., Wolniakowski, A., & Romaniuk, S. (2022) · International Conference on Methods and Models in Automation and Robotics · doi:10.1109/mmar55195.2022.9874296 · Cited by 2
Research works printed but not linked: 5
- Watanabe, M. (2015, January 17–21). Decontamination and concrete core sampling by teleoperated robot at Fukushima Daiichi reactor buildings. Proceedings of the International Conference on Nuclear Engineering: Nuclear Power—Reliable Global Energy, ICONE, Chiba, Japan.
- Minsky, 1980, Telepresence (Essay), OMNI Magazine, Volume 2, 45
- Hussein, 2017, Imitation Learning: A Survey of Learning Methods, ACM Comput. Surv., 50, 21
- Safonova, A., Pollard, N., and Hodgins, J.K. (2003, January 4–8). Optimizing human motion for the control of a humanoid robot. Proceedings of the International Symposium on Adaptive Motion of Animals and Machines (AMAM ’03), Kyoto, Japan.
- Stanton, C., Bogdanovych, A., and Ratanasen, E. (2012, January 3–5). Teleoperation of a humanoid robot using full-body motion capture, example movements, and machine learning. Proceedings of the Australasian Conference on Robotics and Automation (ACRA 2012), Wellington, New Zealand.
Cited by
Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents
Deichler, A., Alexanderson, S., & Beskow, J. (2024) · Proceedings of the ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3652988.3673936
Mamatha, M., Bakkar, A., Hiremath, A., Amruthaiah, X., & Pranith, J. (2024) · International Journal of Science and Research (IJSR) · doi:10.21275/sr24508214759
Turing Machine Development for High Protected Remote Control of the IoT Mobile Platform
Tikhonov, V., Таher, A., Shulakova, K., Tikhonov, S., & Demchenko, O. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-89296-7_5
Robust Real-Time Control System for a Compact 15-DOF Biped Robot
R.Manikandan, K.Subakala, & B.Dinesh, S. B. A. (2025) · International jounal of information technology and computer engineering. · doi:10.62647/ijitce2025v13i4pp356-362
Metadata
- Authors
- Rubies, E., Bitriá, R., Clotet, E., & Palacín, J.
- Affiliations
- Universitat de Lleida (ES)
- Corresponding author
- Palacín, Jordi
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2023-10-09
- Volume
- 13
- Issue
- 19
- Pages
- 11115
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4387450711
- Cited by
- 3
- References
- 76
- Citations by year
- 2025: 1 · 2024: 2
- FWCI
- 0.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repositori ObertUDL (University of Lleida) (submittedVersion, cc-by)
- Funders
- Departament de Recerca i Universitats de la Generalitat de Catalunya (FI SDUR 2022, FI Joan Oró 2023)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- remote control devices, teleoperation, humanoid robots, arm gestures, nonverbal communication, human-robot interaction, assistive robots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.