The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Common metrics for human-robot interaction
Open accessAbstract
This paper describes an effort to identify common metrics for task-oriented human-robot interaction (HRI). We begin by discussing the need for a toolkit of HRI metrics. We then describe the framework of our work and identify important biasing factors that must be taken into consideration. Finally, we present suggested common metrics for standardization and a case study. Preparation of a larger, more detailed toolkit is in progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“In particular, trust is likely to influence reliance on complex, imperfect automation in dynamic environments that require the human to adapt to unanticipated circumstances [36].”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“Since robots are generally designed to operate with some level of autonomy [40], performance measures must consider the autonomy design.”
BackgroundA survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 2×
“, they outwardly appear to be socially intelligent, even if the internal design does not have a basis in cognitive science) [8].”
BackgroundSelf-citationMeasurement of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049499 · Cited by 2,039
Telerobotics, Automation, and Human Supervisory Control
Sheridan, T. B. (1992) · Medical Entomology and Zoology · Cited by 1,949
Human factors in engineering and design
Asfour, S. S. (1988) · International Journal of Industrial Ergonomics · doi:10.1016/0169-8141(88)90028-5 · Cited by 1,807
Human Factors in Engineering and Design
Sanders, M. S., & McCormick, E. J. (1957) · Medical Entomology and Zoology · Cited by 1,572
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Self-citationCasper, J., & Murphy, R. R. (2003) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811794 · Cited by 938
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Bajcsy, R. (1988) · Proceedings of the IEEE · doi:10.1109/5.5968 · Cited by 830
Kunkel, J. M., & Machleder, H. I. (1989) · PubMed · Cited by 804
Theory and evaluation of human robot interactions
Scholtz, J. (2003) · 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the · doi:10.1109/hicss.2003.1174284 · Cited by 433
Self-citationLag as a determinant of human performance in interactive systems
MacKenzie, I. S., & Ware, C. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169431 · Cited by 418
Vehicle Teleoperation Interfaces
Fong, T., & Thorpe, C. (2001) · Autonomous Robots · doi:10.1023/a:1011295826834 · Cited by 406
Self-citationMetrics for Evaluating Human-Robot Interactions
Goodrich, M. A., & Olsen, D. R. (2003) · ScholarsArchive (Brigham Young University) · Cited by 302
Self-citationThe role of expressiveness and attention in human-robot interaction
Bruce, A., Nourbakhsh, I., & Simmons, R. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014396 · Cited by 294
Newman, W. M. (1995) · Cited by 283
Awareness in human-robot interactions
Drury, J. L., Scholtz, J., & Yanco, H. A. (2004) · SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483) · doi:10.1109/icsmc.2003.1243931 · Cited by 258
Self-citationBeyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition
Yanco, H., Drury, J., & Scholtz, J. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_6 · Cited by 247
Self-citationSocially Intelligent Agents: Creating Relationships with Computers and Robots
(2002) · Multiagent Systems, Artificial Societies, and Simulated Organizations · doi:10.1007/b116424 · Cited by 238
Evaluation of human-robot interaction awareness in search and rescue
Scholtz, J. C., Young, J., Drury, J. L., & Yanco, H. A. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1307409 · Cited by 151
Self-citationFong, T., Thorpe, C., & Baur, C. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00378-0 · Cited by 150
Self-citationA Taxonomy for Human-Robot Interaction
Yanco, H. A., & Drury, J. L. (2002) · Cited by 150
Seven principles of efficient human robot interaction
Goodrich, M. A., & Olsen, D. R. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1244504 · Cited by 144
Self-citationCooperation with a robotic assistant
Goetz, J. L., & Kiesler, S. B. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506443.506492 · Cited by 141
Beyond Webcams: An Introduction to Online Robots
(2003) · Sensor Review · doi:10.1108/sr.2003.08723cae.002 · Cited by 136
A quantitative technique for analysing robot-human interactions
Dautenhahn, K., & Werry, I. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1043883 · Cited by 103
A Standard Test Course for Urban Search and Rescue Robots
Jacoff, A. S., Messina, E. R., & Evans, J. (2000) · Performance Metrics for Intelligent Systems · Cited by 99
Autonomy levels for unmanned systems (ALFUS) framework
Huang, H. (2007) · Workshop on Performance Metrics for Intelligent Systems (PerMIS) · doi:10.1145/1660877.1660883 · Cited by 95
Ecological displays for robot interaction: a new perspective
Ricks, B., Nielsen, C. W., & Goodrich, M. A. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2004.1389842 · Cited by 94
Self-citationApplied use of cardiac and respiration measures: Practical considerations and precautions
Wilson, G. F. (1992) · Biological Psychology · doi:10.1016/0301-0511(92)90014-l · Cited by 87
Dautenhahn, K., Werry, I., Rae, J. P., Dickerson, P., Stribling, P., & Ogden, B. (2002) · University of Hertfordshire Research Archive (University of Hertfordshire) · Cited by 66
Kaber, D. B., Riley, J. M., Zhou, R., & Draper, J. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004400505 · Cited by 63
Self-citationA New Method to Evaluate Human-Robot System Performance
Rodriguez, G., & Weisbin, C. R. (2003) · Autonomous Robots · doi:10.1023/a:1022279618991 · Cited by 56
Evaluation of a human-robot interface: development of a situational awareness methodology
Scholtz, J. C., Antonishek, B., & Young, J. (2004) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2004.1265327 · Cited by 56
Self-citationRobotic camera control for remote exploration
Hughes, S., & Lewis, M. (2004) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985757 · Cited by 47
Self-citationNielsen, C. W., Ricks, B., Bruernmer, D., Few, D. A., Walton, M., & Goodrich, M. A. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1400765 · Cited by 38
Self-citationControl gain adaptation in virtual reality mediated human-telerobot interaction
Sheik-Nainar, M. A., KABER, D. B., & Chow, M. (2005) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20025 · Cited by 35
Self-citationAdapting GOMS to model human-robot interaction
Drury, J. L., Scholtz, J. C., & Kieras, D. E. (2007) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1228716.1228723 · Cited by 31
Self-citationExperiments with attitude: attitude displays for teleoperation
Lewis, M., Wang, J., Hughes, S., & Liu, X. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1244598 · Cited by 25
Self-citation(1999) · doi:10.1002/1520-6564(200023)10:4
Cited by
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Self-citationFeil-Seifer, D., & Mataric, M. J. (2005) · 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005. · doi:10.1109/icorr.2005.1501143 · Cited by 972
Metadata
- Authors
- Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., & Goodrich, M.
- Venue
- Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
- Publisher
- ACM
- Published
- 2006-03-02
- Pages
- 33-40
- OpenAlex
- W2153738822
- Cited by
- 756
- References
- 43
- FWCI
- 50.91
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.