The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Do people hold a humanoid robot morally accountable for the harm it causes?
Abstract
Robots will increasingly take on roles in our social lives where they can cause humans harm. When robots do so, will people hold robots morally accountable? To investigate this question, 40 undergraduate students individually engaged in a 15-minute interaction with ATR's humanoid robot, Robovie. The interaction culminated in a situation where Robovie incorrectly assessed the participant's performance in a game, and prevented the participant from winning a $20 prize. Each participant was then interviewed in a 50-minute session. Results showed that all of the participants engaged socially with Robovie, and many of them conceptualized Robovie as having mental/emotional and social attributes. Sixty-five percent of the participants attributed some level of moral accountability to Robovie. Statistically, participants held Robovie less accountable than they would a human, but more accountable than they would a vending machine. Results are discussed in terms of the New Ontological Category Hypothesis and robotic warfare.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Participants who interacted with a humanoid robot that incorrectly assessed their performance perceived the robot as having emotional and social attributes.
“In Kahn et al. (2012), participants who interacted with a humanoid robot that incorrectly assessed their performance perceived the robot as having emotional and social attributes.”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Kahn et al., 2012
Citations
Cites
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 1×
“In the HRI literature, it is clear that people engage with social robots in many social ways [9] [10] [11] [12], and also can attribute intentions and decision-making to robots [13].”
Background
Flagged first, then by citations
Research works printed but not linked: 17
- Searle , J. R. ( 1992 ). The rediscovery of the mind . Cambridge, MA : MIT Press . Searle, J. R. (1992). The rediscovery of the mind. Cambridge, MA: MIT Press. · DOI · Paper page
- 10.1145/1957656.1957755 · DOI
- 10.1109/MRA.2010.940152 · DOI
- Dennett , D. C. ( 1998 ). When HAL kills, who's to blame? Computer ethics . In D. G. Stork (Ed.), HAL's Legacy: 2001's Computer as Dream and Reality ( pp. 351 -- 365 ). Cambridge, MA : MIT Press . Dennett, D. C. (1998). When HAL kills, who's to blame? Computer ethics. In D. G. Stork (Ed.), HAL's Legacy: 2001's Computer as Dream and Reality (pp. 351--365). Cambridge, MA: MIT Press.
- Asaro , P. M. (in press). A body to kick, but still no soul to damn: Legal perspectives on robotics . In P. Lin, K. Abney, & G . Bekey (Eds.), Robot ethics: The ethical and social implications of robotics. Cambridge, MA : MIT Press . Asaro, P. M. (in press). A body to kick, but still no soul to damn: Legal perspectives on robotics. In P. Lin, K. Abney, & G. Bekey (Eds.), Robot ethics: The ethical and social implications of robotics. Cambridge, MA: MIT Press.
- Scheffler , S. ( 1992 ). Human morality . New York, NY : Oxford University Press . Scheffler, S. (1992). Human morality. New York, NY: Oxford University Press.
- Dworkin , R. ( 1986 ). Law's empire . Cambridge, MA : Harvard University Press . Dworkin, R. (1986). Law's empire. Cambridge, MA: Harvard University Press.
- 10.1145/223355.223537 · DOI
- 10.1145/1957656.1957816 · DOI
- 10.1207/s15327051hci1901%262_4 · DOI
- 10.1073/pnas.0707769104 · DOI
- 10.5555/1734454.1734546 · DOI
- 10.1145/1349822.1349836 · DOI
- Turiel , E. ( 1998 ). The development of morality . In W. Damon (Editor-in-Chief), Handbook of Child Psychology : Vol. 3 . Social , emotional, and personality development (pp. 863 -- 932 ). New York, NY : Wiley . Turiel, E. (1998). The development of morality. In W. Damon (Editor-in-Chief), Handbook of Child Psychology: Vol. 3. Social, emotional, and personality development (pp. 863--932). New York, NY: Wiley.
- Kahn P. H. Jr. Kanda T. Ishiguro H. Freier N. G. Severson R. L. Gill B. T. & Shen S. (in press). "Robovie you'll have to go into the closet now": Children's social and moral relationships with a humanoid robot. Developmental Psychology. Kahn P. H. Jr. Kanda T. Ishiguro H. Freier N. G. Severson R. L. Gill B. T. & Shen S. (in press). "Robovie you'll have to go into the closet now": Children's social and moral relationships with a humanoid robot. Developmental Psychology.
- 10.1145/1957656.1957710 · DOI · Paper page
- Singer , P. W. ( 2009 ). Wired for war: The robotics revolution and conflict in the 21st century . New York, NY : Penguin . Singer, P. W. (2009). Wired for war: The robotics revolution and conflict in the 21st century. New York, NY: Penguin.
Cited by
Sorted by citations
Interactions with robots: the truths we reveal about ourselves
Broadbent, E. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-043958 · Cited by 547
Honig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338
Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents
Malle, B. F., Scheutz, M., Arnold, T., Voiklis, J., & Cusimano, C. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696458 · Cited by 246
Artificial Moral Agents: A Survey of the Current Status
Cervantes, J.-A., López, S., Rodríguez, L.-F., Cervantes, S., Cervantes, F., & Ramos, F. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00151-x · Cited by 151
Malle, B. F., Scheutz, M., Forlizzi, J., & Voiklis, J. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451743 · Cited by 107
Zhang, Z., Jia, M., Lee, H.-P. (., Yao, B., Das, S., Lerner, A., Wang, D., & Li, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642385 · Cited by 95
“Work in robot-human interaction has shown that people relate to non-human agents in social ways, including extending moral judgments to them [32], attributing them sociocultural awareness [63], and trusting them based on their behavior and anthropomorphism [51] as well as, most relevantly for our…”
Ffab—the form function attribution bias in human-robot interaction
Haring, K. S., Watanabe, K., Velonaki, M., Tossell, C. C., & Finomore, V. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2851569 · Cited by 78
Liu, P., Du, Y., & Xu, Z. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.02.012 · Cited by 65
Language-Capable Robots may Inadvertently Weaken Human Moral Norms
Jackson, R. B., & Williams, T. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673123 · Cited by 64
Towards morally sensitive action selection for autonomous social robots
Scheutz, M., Malle, B., & Briggs, G. (2015) · 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2015.7333661 · Cited by 59
Human creativity can be facilitated through interacting with a social robot
Kahn, P. H., Kanda, T., Ishiguro, H., Gill, B. T., Shen, S., Ruckert, J. H., & Gary, H. E. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451749 · Cited by 47
Self-citationThe AI Double Standard: Humans Judge All AIs for the Actions of One
Manoli, A., Pauketat, J. V. T., & Anthis, J. R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711083 · Cited by 12
Metadata
- Authors
- Kahn, P. H., Kanda, T., Ishiguro, H., Gill, B. T., Ruckert, J. H., Shen, S., Gary, H. E., Reichert, A. L., Freier, N. G., & Severson, R. L.
- Affiliations
- University of Washington (US)
- Advanced Telecommunications Research Institute International (JP)
- The University of Osaka (JP)
- Seattle Pacific University (US)
- Microsoft (United States) (US)
- Western Washington University (US)
- Venue
- Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
- Publisher
- ACM
- Published
- 2012-03-05
- Pages
- 33-40
- OpenAlex
- W2141563716
- Cited by
- 178
- References
- 1
- Citations by year
- 2026: 8 · 2025: 17 · 2024: 15 · 2023: 15 · 2022: 5 · 2021: 11 · 2020: 17 · 2019: 18 · 2018: 8 · 2017: 9 · 2016: 8 · 2015: 13 · 2014: 15 · 2013: 16 · 2012: 3
- FWCI
- 23.46
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- Social Sciences › Law › Literary and Philosophical Studies
- Keywords
- moral accountability, humanoid robots, anthropomorphism, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review