The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Toward a Framework for Levels of Robot Autonomy in Human-Robot Interaction
Open accessAbstract
A critical construct related to human-robot interaction (HRI) is autonomy, which varies widely across robot platforms. Levels of robot autonomy (LORA), ranging from teleoperation to fully autonomous systems, influence the way in which humans and robots may interact with one another. Thus, there is a need to understand HRI by identifying variables that influence - and are influenced by - robot autonomy. Our overarching goal is to develop a framework for levels of robot autonomy in HRI. To reach this goal, the framework draws links between HRI and human-automation interaction, a field with a long history of studying and understanding human-related variables. The construct of autonomy is reviewed and redefined within the context of HRI. Additionally, the framework proposes a process for determining a robot's autonomy level, by categorizing autonomy along a 10-point taxonomy. The framework is intended to be treated as guidelines to determine autonomy, categorize the LORA along a qualitative taxonomy, and consider which HRI variables (e.g., acceptance, situation awareness, reliability) may be influenced by the LORA.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Erikson, E. H. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.18614668 · Cited by 11,235
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875
Intelligent agents: theory and practice
Wooldridge, M., & Jennings, N. R. (1995) · The Knowledge Engineering Review · doi:10.1017/s0269888900008122 · Cited by 6,810
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“A number of models and theories related to trust in automation (Cohen, Parasuraman, & Freeman, 1998; Dzindolet et al., 2003; Lee & See, 2004; Madhavan & Wiegmann, 2007) and preliminary frameworks of trust in HRI have been proposed (Desai, Stubbs, Steinfeld, & Yanco, 2009; Hancock, Billings, &…”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 4×
“Third, different from the Parasuraman et al. (2000) model, we highlight specific HRI variables that are likely to be influenced by robot autonomy.”
BackgroundResultInfluentialMachines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162
(1999) · Choice Reviews Online · doi:10.5860/choice.36-5109 · Cited by 2,528
The Adoption of Radical and Incremental Innovations: An Empirical Analysis
Dewar, R. D., & Dutton, J. E. (1986) · Management Science · doi:10.1287/mnsc.32.11.1422 · Cited by 2,472
Wellman, H. M., Carey, S., Gleitman, L., Newport, E. L., & Spelke, E. S. (1990) · The MIT Press eBooks · doi:10.7551/mitpress/1811.001.0001 · Cited by 2,419
Is It an agent, or just a program?: A taxonomy for autonomous agents
Franklin, S., & Graesser, A. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0013570 · Cited by 2,286
Human–Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2008) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000005 · Cited by 1,541
The Out-of-the-Loop Performance Problem and Level of Control in Automation
Endsley, M. R., & Kiris, E. O. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064555 · Cited by 1,406
Emotion and sociable humanoid robots
Breazeal, C. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00018-1 · Cited by 1,279
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Human and Computer Control of Undersea Teleoperators
Sheridan, T. B., & Verplank, W. L. (1978) · doi:10.21236/ada057655 · Cited by 1,227
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Murphy, R. R. (2001) · Industrial Robot: An International Journal · doi:10.1108/ir.2001.28.3.266.1 · Cited by 1,052
(2003) · Cited by 969
Casper, J., & Murphy, R. R. (2003) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811794 · Cited by 938
Acceptance of Healthcare Robots for the Older Population: Review and Future Directions
Broadbent, E., Stafford, R., & MacDonald, B. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-009-0030-6 · Cited by 887
Common metrics for human-robot interaction
Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., & Goodrich, M. (2006) · Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction · doi:10.1145/1121241.1121249 · Cited by 756
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2008) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534308x284417 · Cited by 695
Arkin, R. C. (1998) · Cited by 687
Can computer personalities be human personalities?
Nass, C., Moon, Y., Fogg, B. J., Reeves, B., & Dryer, D. C. (1995) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1995.1042 · Cited by 615
Similarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577
Alami, R., Chatila, R., Fleury, S., Ghallab, M., & Ingrand, F. (1998) · The International Journal of Robotics Research · doi:10.1177/027836499801700402 · Cited by 561
Nass, C., Fogg, B. J., & Moon, Y. (1996) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1996.0073 · Cited by 536
Autonomous Robots: From Biological Inspiration to Implementation and Control
Bekey, G. A. (2005) · Cited by 507
Assessing a Multidimensional Measure of Radical Technological Innovation
Green, S. G., Gavin, M. B., & Aiman-Smith, L. (1995) · IEEE Transactions on Engineering Management · doi:10.1109/17.403738 · Cited by 457
Theory and evaluation of human robot interactions
Scholtz, J. (2003) · 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the · doi:10.1109/hicss.2003.1174284 · Cited by 433
Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition
Endsley, M. R. (2016) · doi:10.1201/b11371 · Cited by 424
Humans: Still Vital After All These Years of Automation
Parasuraman, R., & Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x312198 · Cited by 401
Classifying human-robot interaction: an updated taxonomy
Yanco, H. A., & Drury, J. (2005) · 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583) · doi:10.1109/icsmc.2004.1400763 · Cited by 373
Mutlu (2008) · doi:10.1145/1349822.1349860 · Cited by 366
Toward a Framework for Human-Robot Interaction
Thrun, S. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_2 · Cited by 330
Can robots be teammates?: Benchmarks in human–robot teams
Groom, V., & Nass, C. (2007) · Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.8.3.10gro · Cited by 300
Measuring team situation awareness in decentralized command and control environments
Gorman, J. C., Cooke, N. J., & Winner, J. L. (2006) · Ergonomics · doi:10.1080/00140130600612788 · Cited by 295
Toward Acceptable Domestic Robots: Applying Insights from Social Psychology
Young, J. E., Hawkins, R., Sharlin, E., & Igarashi, T. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0006-y · Cited by 266
"Now, i have a body": uses and social norms for mobile remote presence in the workplace
Lee, M. K., & Takayama, L. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978950 · Cited by 261
Exploring use cases for telepresence robots
Tsui, K. M., Desai, M., Yanco, H. A., & Uhlik, C. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957664 · Cited by 249
Metrics for Evaluating Human-Robot Interactions
Goodrich, M. A., & Olsen, D. R. (2003) · ScholarsArchive (Brigham Young University) · Cited by 244
Impact of robot failures and feedback on real-time trust
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H. (2013) · 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483596 · Cited by 234
Who should i blame? effects of autonomy and transparency on attributions in human-robot interaction
Kim, T., & Hinds, P. (2006) · ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2006.314398 · Cited by 217
Effects of changing reliability on trust of robot systems
Desai, M., Medvedev, M., Vázquez, M., McSheehy, S., Gadea-Omelchenko, S., Bruggeman, C., Steinfeld, A., & Yanco, H. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157702 · Cited by 188
Hancock, P. A., Billings, D. R., & Schaefer, K. E. (2011) · Ergonomics in Design: The Quarterly of Human Factors Applications · doi:10.1177/1064804611415045 · Cited by 188
Mental Workload and Situation Awareness
Tsang, P. S., & Vidulich, M. A. (2006) · Handbook of Human Factors and Ergonomics · doi:10.1002/0470048204.ch9 · Cited by 184
Shared Understanding for Collaborative Control
Bruemmer, D. J., Few, D. A., Boring, R. L., Marble, J. L., Walton, M. C., & Nielsen, C. W. (2005) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2005.850599 · Cited by 182
Autonomy and Common Ground in Human-Robot Interaction: A Field Study
Stubbs, K., Hinds, P. J., & Wettergreen, D. (2007) · IEEE Intelligent Systems · doi:10.1109/mis.2007.21 · Cited by 164
Benchmarks for evaluating socially assistive robotics
Feil-Seifer, D., Skinner, K., & Matarić, M. J. (2007) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.8.3.07fei · Cited by 156
Impact of robot failures and feedback on real-time trust
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A. M., & Yanco, H. A. (2013) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.5555/2447556.2447663 · Cited by 155
Nass, C., Steuer, J., Henriksen, L., & Dryer, D. C. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1025 · Cited by 150
Seven principles of efficient human robot interaction
Goodrich, M. A., & Olsen, D. R. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1244504 · Cited by 144
Attitudinal and Intentional Acceptance of Domestic Robots by Younger and Older Adults
Ezer, N., Fisk, A. D., & Rogers, W. A. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02710-9_5 · Cited by 134
Self-citationFollow-up analysis of mobile robot failures
Carlson, J., Murphy, R. R., & Nelson, A. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1302508 · Cited by 117
Telerobotic control using augmented reality
Milgram, P., Rastogi, A., & Grodski, J. J. (2002) · IEEE RO-MAN · doi:10.1109/roman.1995.531930 · Cited by 100
Survey of metrics for human-robot interaction
Murphy, R. R., & Schreckenghost, D. L. (2013) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483569 · Cited by 93
Assisted driving of a mobile remote presence system: System design and controlled user evaluation
Takayama, L. A., Marder-Eppstein, E., Harris, H., & Beer, J. M. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979637 · Cited by 87
Self-citationHuman-Robot Interactions: Creating Synergistic Cyber Forces
Scholtz, J. C. (2002) · Springer eBooks · doi:10.1007/978-94-017-2376-3_19 · Cited by 87
A Framework For Autonomy Levels For Unmanned Systems (ALFUS)
Huang, H., Pavek, K., Novak, B., et al. (2005) · Cited by 75
Breazeal, C. (2005) · interactions · doi:10.1145/1052438.1052455 · Cited by 74
Effects of changing reliability on trust of robot systems
Desai, Medvedev, Vázquez, McSheehy, Gadea-Omelchenko, Bruggeman, Steinfeld, & Yanco (2012) · Cited by 72
Creating Trustworthy Robots: Lessons and Inspirations from Automated Systems
Desai, M., Stubbs, K. N., Steinfeld, A., & Yanco, H. A. (2018) · Figshare · doi:10.1184/r1/6552464 · Cited by 65
Blending human and robot inputs for sliding scale autonomy
Desai, M., & Yanco, H. A. (2006) · IEEE RO-MAN · doi:10.1109/roman.2005.1513835 · Cited by 64
Older adults' medication management in the home: How can robots help?
Prakash, A., Beer, J. M., Deyle, T., Smarr, C.-A., Chen, T. L. B., Mitzner, T. L., Kemp, C. C., & Rogers, W. A. (2013) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483600 · Cited by 59
Self-citationEvaluation of a human-robot interface: development of a situational awareness methodology
Scholtz, J. C., Antonishek, B., & Young, J. (2004) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2004.1265327 · Cited by 56
Investigation of multi-modal interface features for adaptive automation of a human–robot system
KABER, D. B., Wright, M. C., & Sheik-Nainar, M. A. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.11.003 · Cited by 53
Choosing Autonomy Modes for Multirobot Search
Lewis, M., Wang, H., Chien, S. Y., Velagapudi, P., Scerri, P., & Sycara, K. P. (2010) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810366859 · Cited by 44
The Hunt for Situation Awareness: Human-Robot Interaction in Search and Rescue
Riley, J. M., & Endsley, M. R. (2004) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120404800389 · Cited by 40
APPLICATION OF INTELLIGENT AUTOMATA TO RECONNAISSANCE.
Rosen, C. A., & Nilsson, N. J. (1968) · Defense Technical Information Center (DTIC) · Cited by 33
Some non-technology implications for wider application of robots assisting older people
Tiwari, P., Warren, J., Day, K., & McDonald, B. A. (2010) · ResearchSpace (University of Auckland) · Cited by 21
Johnson, M., Bradshaw, J. M., Feltovich, P. J., Jonker, C. M., Sierhuis, M., & van Riemsdijk, M. B. (2010) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.5555/1734454.1734492 · Cited by 7
“Seamless Autonomy”: Removing autonomy level stratifications
Few, D. A., Smart, W. D., Bruemmer, D. J., & Neilsen, C. (2008) · Conference on Human System Interactions · doi:10.1109/hsi.2008.4581480 · Cited by 3
(1999) · doi:10.1002/1520-6564(200023)10:4
Cited by
Transforming the Customer Experience through New Technologies
Hoyer, W. D., Kroschke, M., Schmitt, B., Kraume, K., & Shankar, V. (2020) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2020.04.001 · Cited by 1,049
Trust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Dimensions of artificial intelligence anxiety based on the integrated fear acquisition theory
Li, J., & Huang, J.-S. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101410 · Cited by 453
Zizic, M. C., Mladineo, M., Gjeldum, N., & Celent, L. (2022) · Energies · doi:10.3390/en15145221 · Cited by 420
Acceptance of artificial intelligence among pre-service teachers: A multigroup analysis
Zhang, C., Schießl, J., Plößl, L., Hofmann, F., & Gläser-Zikuda, M. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00420-7 · Cited by 413
Metadata
- Authors
- Beer, J. M., Fisk, A. D., & Rogers, W. A.
- Venue
- Journal of Human-Robot Interaction
- Publisher
- Journal of Human-Robot Interaction
- Published
- 2014-06-01
- Volume
- 3
- Issue
- 2
- Pages
- 74
- ISSN
- 2163-0364 (ISSN-L)
- OpenAlex
- W2109135966
- Cited by
- 629
- References
- 78
- FWCI
- 19.55
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.