The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Common metrics for human-robot interaction
Open accessAbstract
This paper describes an effort to identify common metrics for task-oriented human-robot interaction (HRI). We begin by discussing the need for a toolkit of HRI metrics. We then describe the framework of our work and identify important biasing factors that must be taken into consideration. Finally, we present suggested common metrics for standardization and a case study. Preparation of a larger, more detailed toolkit is in progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“In particular, trust is likely to influence reliance on complex, imperfect automation in dynamic environments that require the human to adapt to unanticipated circumstances [36].”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“Since robots are generally designed to operate with some level of autonomy [40], performance measures must consider the autonomy design.”
BackgroundA survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 2×
“, they outwardly appear to be socially intelligent, even if the internal design does not have a basis in cognitive science) [8].”
BackgroundSelf-citationMeasurement of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049499 · Cited by 2,039 · cited 4×
“SAGAT has been used to assess SA at a various levels of autonomy [25, 44].”
InfluentialTelerobotics, Automation, and Human Supervisory Control
Sheridan, T. B. (1992) · Medical Entomology and Zoology · Cited by 1,949
Human factors in engineering and design
Asfour, S. S. (1988) · International Journal of Industrial Ergonomics · doi:10.1016/0169-8141(88)90028-5 · Cited by 1,807
Human Factors in Engineering and Design
Sanders, M. S., & McCormick, E. J. (1957) · Medical Entomology and Zoology · Cited by 1,572
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Self-citationCasper, J., & Murphy, R. R. (2003) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811794 · Cited by 938
Cited by
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Self-citationFeil-Seifer, D., & Mataric, M. J. (2005) · 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005. · doi:10.1109/icorr.2005.1501143 · Cited by 972
Human Performance Issues and User Interface Design for Teleoperated Robots
Chen, J. Y. C., Haas, E. C., & Barnes, M. J. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.905819 · Cited by 646
“Human performance issues involved in teleoperating unmanned systems generally fall in two categories, i.e., remote perception and remote manipulation, which includes both navigation and manipulation tasks (e.g., grasping, pushing , and payload management) [14].”
BackgroundToward a Framework for Levels of Robot Autonomy in Human-Robot Interaction
Beer, J. M., Fisk, A. D., & Rogers, W. A. (2014) · Journal of Human-Robot Interaction · doi:10.5898/jhri.3.2.beer · Cited by 629
Socially assistive robotics [Grand Challenges of Robotics]
Tapus, A., Mataric, M., & Scassellati, B. (2007) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2007.339605 · Cited by 547
Exploring customer experiences with robotics in hospitality
Tung, V. W. S., & Au, N. (2018) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-06-2017-0322 · Cited by 479
Human Interaction With Robot Swarms: A Survey
Kolling, A., Walker, P., Chakraborty, N., Sycara, K., & Lewis, M. (2016) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2480801 · Cited by 424
Self-citationHuman – robot interaction review and challenges on task planning and programming
Tsarouchi, P., Makris, S., & Chryssolouris, G. (2016) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2015.1130251 · Cited by 376
A survey of Tactile Human–Robot Interactions
Argall, B. D., & Billard, A. G. (2010) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2010.07.002 · Cited by 350
How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot Interaction
Saunderson, S., & Nejat, G. (2019) · International Journal of Social Robotics · doi:10.1007/s12369-019-00523-0 · Cited by 325
Human–robot interaction in agriculture: A survey and current challenges
Vasconez, J. P., Kantor, G. A., & Auat Cheein, F. A. (2019) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2018.12.005 · Cited by 315
Teleoperation of Humanoid Robots: A Survey
Darvish, K., Penco, L., Ramos, J., Cisneros, R., Pratt, J., Yoshida, E., Ivaldi, S., & Pucci, D. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3236952 · Cited by 278
Coronado, E., Kiyokawa, T., Ricardez, G. A. G., Ramirez-Alpizar, I. G., Venture, G., & Yamanobe, N. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.04.007 · Cited by 276
Measuring Trust in Human Robot Interactions: Development of the “Trust Perception Scale-HRI”
Schaefer, K. E. (2016) · Robust Intelligence and Trust in Autonomous Systems · doi:10.1007/978-1-4899-7668-0_10 · Cited by 270
Hebesberger, D., Koertner, T., Gisinger, C., & Pripfl, J. (2017) · International Journal of Social Robotics · doi:10.1007/s12369-016-0391-6 · Cited by 163
(2009) · doi:10.1075/is.10.3.06wis · Cited by 124
Godspeed Questionnaire Series: Translations and Usage
Bartneck, C. (2023) · International Handbook of Behavioral Health Assessment · doi:10.1007/978-3-030-89738-3_24-1 · Cited by 100
Common Metrics to Benchmark Human-Machine Teams (HMT): A Review
Damacharla, P., Javaid, A. Y., Gallimore, J. J., & Devabhaktuni, V. K. (2020) · arXiv · doi:10.48550/arxiv.2008.04855 · Cited by 97
I'm sorry, Dave: i'm afraid i won't do that: social aspects of human-agent conflict
Takayama, L., Groom, V., & Nass, C. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519021 · Cited by 67
Berthet-Rayne, P., Leibrandt, K., Gras, G., Fraisse, P., Crosnier, A., & Yang, G.-Z. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2812907 · Cited by 58
Olde Keizer, R. A. C. M., van Velsen, L., Moncharmont, M., Riche, B., Ammour, N., Del Signore, S., Zia, G., Hermens, H., & N’Dja, A. (2019) · Health and Technology · doi:10.1007/s12553-019-00320-9 · Cited by 57
A survey on verification strategies for intelligent transportation systems
Schmidtke, H. R. (2018) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-018-0070-5 · Cited by 19
“[86] assess navigation, perception,management, manipulation, and social performance.”
A Tool to Facilitate Learning in a Complex ManualControl Task
(2017) · elib (German Aerospace Center) · doi:10.5923/j.ijap.20170704.01 · Cited by 9
Metadata
- Authors
- Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., & Goodrich, M.
- Venue
- Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
- Publisher
- ACM
- Published
- 2006-03-02
- Pages
- 33-40
- OpenAlex
- W2153738822
- Cited by
- 756
- References
- 43
- FWCI
- 50.91
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.