Robot System Assistant (RoSA): Towards Intuitive Multi-Modal and Multi-Device Human-Robot Interaction
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
This paper presents an implementation of RoSA, a Robot System Assistant, for safe and intuitive human-machine interaction. The interaction modalities were chosen and previously reviewed using a Wizard of Oz study emphasizing a strong propensity for speech and pointing gestures. Based on these findings, we design and implement a new multi-modal system for contactless human-machine interaction based on speech, facial, and gesture recognition. We evaluate our proposed system in an extensive study with multiple subjects to examine the user experience and interaction efficiency. It reports that our method achieves similar usability scores compared to the entirely human remote-controlled robot interaction in our Wizard of Oz study. Furthermore, our framework’s implementation is based on the Robot Operating System (ROS), allowing modularity and extendability for our multi-device and multi-user method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures













![Figure 14 Pointing gesture: User points to cube [S], which is enveloped by the laser pointer.](https://figures.cochat.ai/paper-figures/f6240400bcb54895837e7f8f5cc9e408/robot-system-assistant-rosa-towards-intuitive-multi-modal-and-multi-device-human-figure-14.jpg)




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies [12,14,17,21] focus on users with high technical demands or operational autonomy, such as evaluators of language models [17], operators of automated vehicles [13], participants in spaceflight simulations [21], or users in automated driving simulators [5].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In collaborative or mobile environments, where interaction may be asynchronous or interrupted, solutions such as modular screens, simplified navigation systems, and functional colors to distinguish roles or tasks are highlighted [8,14,19,22].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Systems with projected or multimodal interfaces [2,7,14,15,19] also show notable performance improvements, minimizing repeated or incorrect actions through optimized information visualization.”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Projected or multimodal interfaces in industrial workstations also contribute to reducing human errors [2,6,14,15,19].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In industrial environments with multitasking and operational pressure, robust and clear interfaces are necessary to prevent errors [2,6,12,14,15,19,22,30].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781 · cited 3×
“The network was trained on the refined MS-Celeb-1M dataset using the loss function Arcface [23].”
BackgroundMethodWIDER FACE: A Face Detection Benchmark
Yang, S., Luo, P., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.596 · Cited by 1,830 · cited 1×
“The network was pre-trained on a WIDER FACE dataset [34].”
MethodRetinaFace: Single-Shot Multi-Level Face Localisation in the Wild
Deng, J., Guo, J., Ververas, E., Kotsia, I., & Zafeiriou, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00525 · Cited by 1,681 · cited 5×
“detected faces Face Id 512 features ∈ [0, 1] 7 features ∈ [0, 1] 4 features for each ∈ (x, y) (in pixels) 1 features for each ∈ (x, y) (in pixels) 5 features for each ∈ (x, y) (in pixels) 1 feature ∈ Z>0 1 feature ∈ Z>0 ArcFace [23] Residual Masking Network [24] RetinaFace [25] post processed RetinaFace [25] post proc…”
BackgroundMethodInfluentialHead Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devices
Chen, S., Liu, Y., Gao, X., & Han, Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-97909-0_46 · Cited by 771
Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies
Lewis, J. R. (2002) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2002.9669130 · Cited by 621 · cited 1×
“The questionnaires (SUS [55], UMUX [56], PSSUQ [57], and ASQ [58]) were completed after the experiment.”
MethodThe Usability Metric for User Experience
Finstad, K. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.004 · Cited by 604 · cited 1×
“The questionnaires (SUS [55], UMUX [56], PSSUQ [57], and ASQ [58]) were completed after the experiment.”
MethodGaze360: Physically Unconstrained Gaze Estimation in the Wild
Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00701 · Cited by 470
Automatic Speech Recognition: A Survey
Malik, M., Malik, M. K., Mehmood, K., & Makhdoom, I. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10073-7 · Cited by 358 · cited 1×
“The performance of a speech recognition system is measured by the Word Error Rate (WER): where S is the number of words incorrectly replaced, I represents the number of additional words inserted, D is the number of words deleted, and N is the number of words correctly transcribed [59].”
Method
Research works printed but not linked: 4
- Hannun, A., Case, C., Casper, J., Catanzaro, B., Diamos, G., Elsen, E., Prenger, R., Satheesh, S., Sengupta, S., and Coates, A. (2014). Deepspeech: Scaling up end-to-end speech recognition. arXiv.
- Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
- Guo, X., Li, S., Yu, J., Zhang, J., Ma, J., Ma, L., Liu, W., and Ling, H. (2019). PFLD: A practical facial landmark detector. arXiv.
- Bocklisch, T., Faulkner, J., Pawlowski, N., and Nichol, A. (2017). Rasa: Open source language understanding and dialogue management. arXiv.
Cited by
Recent advancements in multimodal human–robot interaction
Su, H., Qi, W., Chen, J., Yang, C., Sandoval, J., & Laribi, M. A. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1084000 · Cited by 181
L2CS-Net : Fine-Grained Gaze Estimation in Unconstrained Environments
Abdelrahman, A. A., Hempel, T., Khalifa, A., Al-Hamadi, A. K., & Dinges, L. (2023) · International Conference on Frontiers of Signal Processing (ICFSP) · doi:10.1109/icfsp59764.2023.10372944 · Cited by 127
“It indicates the user’s level of engagement in human-robot interaction [1,2], and open dialogue systems [3].”
BackgroundSelf-citationCobotics: The Evolving Roles and Prospects of Next‐Generation Collaborative Robots in Industry 5.0
Rahman, M. M., Khatun, F., Jahan, I., Devnath, R., & Bhuiyan, M. A.-A. (2024) · Journal of Robotics · doi:10.1155/2024/2918089 · Cited by 121
Chu, C., & Liu, Y.-L. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.04.007 · Cited by 71
Research Progress of Human–Computer Interaction Technology Based on Gesture Recognition
Zhou, H., Wang, D., Yu, Y. W., & Zhang, Z. (2023) · Electronics · doi:10.3390/electronics12132805 · Cited by 91
Self-powered eye-computer interaction via a triboelectric nanogenerator
Yin, J., Kashyap, V., Wang, S., Xiao, X., Tat, T., & Chen, J. (2024) · Device · doi:10.1016/j.device.2023.100252 · Cited by 38
Halim, J., Eichler, P., Krusche, S., Bdiwi, M., & Ihlenfeldt, S. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.1001955 · Cited by 34
Face Recognition and Tracking Framework for Human–Robot Interaction
Khalifa, A., Abdelrahman, A. A., Strazdas, D., Hintz, J., Hempel, T., & Al-Hamadi, A. K. (2022) · Applied Sciences · doi:10.3390/app12115568 · Cited by 38
“We employ the proposed framework on a real HRI study [6], to further evaluate the framework in real-time HRI and show its robustness.”
BackgroundMethodInfluentialSelf-citationTowards efficient and robust face recognition through attention-integrated multi-level CNN
Khalifa, A., Abdelrahman, A. A., Hempel, T., & Al-Hamadi, A. K. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19521-0 · Cited by 30
“Its applications span diverse sectors, encompassing security [30], video surveillance [4], and human-robot interaction [29, 44].”
Self-citationComparing alternative modalities in the context of multimodal human–robot interaction
Saren, S., Mukhopadhyay, A., Ghose, D., & Biswas, P. (2023) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-023-00421-w · Cited by 19
Recent advances in human–robot interaction: robophobia or synergy
Dzedzickis, A., Vaičiūnas, G., Lapkauskaitė, K., Viržonis, D., & Bučinskas, V. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02362-x · Cited by 19
Heo, I.-S., Putri, A. K. H., Kim, B.-S., Kwon, M. S., & Kim, S. (2023) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.21014 · Cited by 14
“Recently, increasing efforts have been made to overcome the limitations of interaction by combining various modalities, such as voice, gesture recognition, and extended reality technology (Dallel et al., 2023; Panagou et al., 2022; Strazdas et al., 2022).”
BackgroundPointing Gestures for Human-Robot Interaction with the Humanoid Robot Digit
Lorentz, V., Weiß, M., Hildebrand, K., & Boblan, I. W. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309407 · Cited by 12
“Strazdas et al. [4], [5] proposed a multimodal interaction with speech, gaze tracking and pointing gestures recognition.”
BackgroundMethodYoon, S., Park, M., & Ahn, C. R. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5715 · Cited by 16
Gaze Estimation Based on Attention Mechanism Combined With Temporal Network
Ren, G., Zhang, Y., & Feng, Q. (2023) · IEEE Access · doi:10.1109/access.2023.3317013 · Cited by 10
Analysis of the parametric configuration impact on BallBot control performance
Pham, A., Thai, B.-H., Dang, P. V., & Vo, N. T. (2024) · International journal of mechanical system dynamics · doi:10.1002/msd2.12133 · Cited by 10
FSKT‐GE: Feature maps similarity knowledge transfer for low‐resolution gaze estimation
Yan, C., Pan, W., Dai, S., Xu, B., Xu, C., Liu, H., & Li, X. (2024) · IET Image Processing · doi:10.1049/ipr2.13056 · Cited by 9
Fine-grained gaze estimation based on the combination of regression and classification losses
Abdelrahman, A. A., Hempel, T., Khalifa, A., & Al-Hamadi, A. K. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05778-3 · Cited by 10
Self-citationCognitive Hexagon-Controlled Intelligent Speech Interaction System
Chaurasiya, H. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3168807 · Cited by 12
Wang, X., Zhou, J. S., Wang, L., Yin, Y., Wang, Y., & Ding, Z. (2023) · Electronics · doi:10.3390/electronics12071704 · Cited by 10
Chojecki, P., Strazdas, D., Przewozny, D., Gard, N., Runde, D., Hoerner, N., Al-Hamadi, A., Eisert, P., & Bosse, S. (2023) · doi:10.20944/preprints202304.0415.v2 · Cited by 7
Self-citation(2023) · doi:10.3390/s23115043 · Cited by 7
“The implementation relied on using activation keywords, to start the speech input and to make the system “listen”, which further increased the processing time and the frustration of the user [50].”
MethodSelf-citationDiGeTac Unit for Multimodal Communication in Human–Robot Interaction
Al, G. A., & Martínez-Hernández, U. (2024) · IEEE Sensors Letters · doi:10.1109/lsens.2024.3391876 · Cited by 7
Human Robot Collaboration in Industrial Applications
Yang, Y., Wang, Y., Cao, Y., Zhao, Z., Liu, X., Wang, Y., Zhang, H., & Pan, Y. (2023) · International Conference on Virtual Reality · doi:10.1109/icvr57957.2023.10169650 · Cited by 6
“However, in the case of MHRI, a robot-robot relationship exists as well [7].”
BackgroundA multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark
Yoshida, A., Dossa, R. F. J., Vincenzo, M. D., Sujit, S., Douglas, H., & Arulkumaran, K. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1528754 · Cited by 9
Mobgazenet: robust gaze estimation mobile network based on progressive attention mechanisms
Abdelrahman, A. A., Hempel, T., Khalifa, A., Strazdas, D., & Al-Hamadi, A. K. (2025) · Machine Vision and Applications · doi:10.1007/s00138-025-01690-z · Cited by 5
“…role in numerous applications, such as driver engagement prediction [1, 17, 20, 23, 29, 43, 53, 59, 61], human-robot interaction [2, 22, 31, 32, 50], open dialogue systems [6, 35] and virtual/augmented overall face image; (2) traditional CNNs [10, 81] struggle to capture fine-grained gaze…”
Self-citationVizcarra, A., Quiroz, G., & Cornejo, J. (2026) · Designs · doi:10.3390/designs10010008 · Cited by 3
Strazdas, D., Busch, M., Shaji, R., Siegert, I., & Al-Hamadi, A. K. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1561188 · Cited by 4
“The preceding publication RoSA 2 offers comprehensive information regarding the various CubeMessage permutations and their resulting outcomes (Strazdas et al., 2022).”
Self-citationDeep Learning-Based Gaze Estimation: A Review
Abdelrahman, A. A., Al-Tawil, B., & Al-Hamadi, A. K. (2026) · Robotics · doi:10.3390/robotics15040069 · Cited by 3
Self-citationHuang, X., Rendón-Morales, E., & Avilés‐Espinosa, R. (2024) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea60663.2024.10596756 · Cited by 3
“ROSA (MedTech Surgical Inc., Newark, USA) is a robot-assisted system developed for stereotactic neurosurgery [2].”
BackgroundStructured and Unstructured Speech2Action Frameworks for Human–Robot Collaboration: A User Study
Kodur, K., Zand, M., Tognotti, M., Jauregui, C., & Kyrarini, M. (2026) · IEEE Access · doi:10.1109/access.2026.3653715 · Cited by 5
“These interfaces have been extensively explored in the field of robotics [16], [17], [18], [19], [20], [21], [22], [23].”
ROS-Based Multirobot System for Collaborative Interaction
Burgh-Oliván, M., Aragüés, R., & Nicolás, G. L. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-21065-5_34 · Cited by 3
Structured and Unstructured Speech2Action Frameworks for Human-Robot Collaboration: A User StudyPreprint
Kodur, K., Zand, M., Tognotti, M., Jauregui, C., & Kyrarini, M. (2023) · doi:10.36227/techrxiv.24022452 · Cited by 3
Application of augmented reality and surgical robotic navigation in total hip and knee replacement
Zhang, X., Liu, Y., Luo, W., & Guo, Y. (2025) · Frontiers in Surgery · doi:10.3389/fsurg.2025.1591756 · Cited by 7
R., E. D. T., Loureiro, M., Machado, F., de Mello, R. C., H., M. F. J., & Frizera, A. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.07.139 · Cited by 2
Automating synthetic dataset generation for image-based 3D detection: a literature review
Schulz, P., Hempel, T., Jung, M., & Al-Hamadi, A. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11431-3 · Cited by 1
“Beyond that, these abilities form the basis for long-standing milestones, such as natural human-robot collaboration (Strazdas et al. 2022, 2020), fully self-driving cars (SAE 2016) or embodied artificial intelligence (Liu et al. 2024).”
Self-citationD’Attanasio, S., Flipo, A., Mimault, J., & Studzińska, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-07623-6_9 · Cited by 1
Jung, M., Yang, Q., von Seelstrang, L., Strazdas, D., Wachsmuth, S., & Al-Hamadi, A. K. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3776734.3794550 · Cited by 1
Self-citationGazeCLIP: Enhancing gaze estimation through text-guided multimodal learning
Wang, J., Ruan, H., Wen, L., Dai, Y., & Wang, M. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133584 · Cited by 5
GESTRO: Skeleton-Based Dynamic Gesture Recognition for Robot Teleoperation
Hempel, T., Jung, M., Khan, A. A., & Al-Hamadi, A. K. (2026) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-026-02395-9 · Cited by 1
Self-citationNassiuma, I., Goh, Y. M., & Hubbard, E. (2024) · European Conference on Cognitive Ergonomics · doi:10.1145/3673805.3673844 · Cited by 1
“A study by Strazdas et al. [21] highlight the benefits of multimodal interfaces that combine visual, auditory, and haptic cues.”
Decision-Making Algorithm Based on Multiple Context-Aware Agents for Human-Robot Interaction
R., E. D. T., Zanetti, G. G., de Mello, R. C., H., M. F. J., Oliveira-Santos, T., & Frizera, A. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228520 · Cited by 1
“Their functionality can be extended through programmatic modules that configure toolcalls, enabling the activation of specific actions in robots based on parameters defined during conversation [12–14].”
Cloud Data Transfer and Harmful Activity Detection using
Venkatesan, K. G. S., Jothiprakash, V. M., & Nalini, T. (2023) · International Journal of Scientific Methods in Engineering and Management · doi:10.58599/ijsmem.2023.1401
Clustering Techniques for Person Authentication from Online Intelligence Data Inspired by Nature
Kawadkar, P., Rebecca, B., & Sagar, P. K. (2023) · International Journal of Scientific Methods in Engineering and Management · doi:10.58599/ijsmem.2023.1404
Editorial for the Special Issue Recognition Robotics
Martínez‐Otzeta, J. M. (2023) · Sensors · doi:10.3390/s23208515
“In [14], Strazdas et al. introduce RoSA, a framework that facilitates human–robot interactions using speech and gestures.”
BackgroundAn Online Education Effect Assessing Method Based on YOLOv8 and Vision Transformer
Zhang, B., Liu, Z., & Zeng, X. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10450498 · Cited by 1
“The information provided by human gaze, as a typical form of nonverbal expression, is commonly utilized in various scenarios such as human-robot interaction [4,5], AR/VR [6], autonomous driving [7].”
BackgroundMultimodal Low-Cost Device for AI Projects Deployment and PoC Validation
Bulín, M., Neduchal, P., & Švec, J. (2024) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2024.07.363
Assistive Robots in Older Adult Care: A Systematic Review and Prospects
Yang, Y., & Zhou, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92710-2_12 · Cited by 2
Automating 3D Dataset Generation with Neural Radiance Fields
Schulz, P., Hempel, T., & Al-Hamadi, A. K. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-00986-9_3
Self-citationSomarathna, R., Perera, M., Xi, M., Krumpholz, A., & Adcock, M. (2025) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3764687.3770726 · Cited by 1
The Application of Telemedicine in Surgery
Yang, Y., Liu, C. Y., Sun, X., Wang, Y., Zhao, M., Jiang, S., Zhang, H., Zhang, W., & Shi, W. (2026) · Med Research · doi:10.1002/mdr2.70061
Human-centric multimodal data processing for human-robot collaboration: A survey
Li, Q., Liu, M., Liu, S., Liu, X., Cui, H., & Liu, J. (2026) · Computers & Industrial Engineering · doi:10.1016/j.cie.2026.112271
Adaptive Human–Robot Collaboration and Interface Design in Multi-robot Environments
Bhore, P. P., Vijayakumar, V. R., Jagadeeswari, M., & Deshpande, P. (2026) · Studies in systems, decision and control · doi:10.1007/978-3-032-21150-7_13
Chen, H., & Zhu, Z. (2026) · Sensors · doi:10.3390/s26185794
“Speech-driven robotic systems commonly connect recognition output to motion or task modules [2–4].”
Metadata
- Authors
- Strazdas, D., Hintz, J., Khalifa, A., Abdelrahman, A. A., Hempel, T., & Al-Hamadi, A.
- Affiliations
- Otto-von-Guericke-Universität Magdeburg (DE)
- Corresponding author
- Strazdas, Dominykas
- Al-Hamadi, Ayoub
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2022-01-25
- Volume
- 22
- Issue
- 3
- Pages
- 923
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC8838571
- OpenAlex
- W4210532635
- Cited by
- 53
- References
- 45
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 12 · 2023: 16 · 2022: 4
- FWCI
- 9.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Federal Ministry of Education and Research (03ZZ0448L, 03ZZ04X02B)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- human-robot interaction, multimodal interaction, multi-device interaction, multi-user interaction, speech recognition, gesture recognition, face recognition, touchless interaction, Wizard-of-Oz study, Robot Operating System, robotic assistants, usability evaluation, interaction efficiency
- MeSH terms
- Gestures, Humans, Robotics, Software, Speech
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.