Language-Capable Robots may Inadvertently Weaken Human Moral Norms
Abstract
Previous research in moral psychology and human-robot interaction has shown that technology shapes human morality, and research in human-robot interaction has shown that humans naturally perceive robots as moral agents. Accordingly, we propose that language-capable autonomous robots are uniquely positioned among technologies to significantly impact human morality. We therefore argue that it is imperative that language-capable robots behave according to human moral norms and communicate in such a way that their intention to adhere to those norms is clear. Unfortunately, the design of current natural language oriented robot architectures enables certain architectural components to circumvent or preempt those architectures' moral reasoning capabilities. In this paper, we show how this may occur, using clarification request generation in current dialog systems as a motivating example. Furthermore, we present experimental evidence that the types of behavior exhibited by current approaches to clarification request generation can cause robots to (1) miscommunicate their moral intentions and (2) weaken humans' perceptions of moral norms within the current context. This work strengthens previous preliminary findings, and does so within an experimental paradigm that provides increased external and ecological validity over earlier approaches.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Robots may be accepted as informed community members, granting them an outsized potential for persuasion and influence.
“robots may be accepted as informed community members (although cp. [7]), granting them an outsized potential for persuasion and influence [26, 50, 53].”
From Robots for Social Justice (R4SJ): Toward a More Equitable Practice of Human-Robot Interaction (2024) · cites this paper as [26]
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221 · see citing works
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · see citing works
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1038/109132a0 · Cited by 7,837 · see citing works
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567 · see citing works
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · see citing works
Presumptive Meanings: The Theory of Generalized Conversational Implicature
Levinson, S. C. (2000) · doi:10.7551/mitpress/5526.001.0001 · Cited by 2,404 · see citing works
Presumptive meanings: The theory of generalized conversational implicature
Levinson, S. C. (2000) · Max Planck Institute for Plasma Physics · Cited by 2,279 · see citing works
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · see citing works
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734 · see citing works
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617 · see citing works
What are the odds? A practical guide to computing and reporting Bayes factors
Jarosz, A. F., & Wiley, J. (2014) · The Journal of Problem Solving · doi:10.7771/1932-6246.1167 · Cited by 1,101 · see citing works
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 971 · see citing works
Robots for Use in Autism Research
Scassellati, B. M., Admoni, H., & Matarić, M. J. (2012) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071811-150036 · Cited by 954 · see citing works
Moralizing Technology: Understanding and Designing the Morality of Things
Verbeek, P.-P. (2011) · doi:10.7208/chicago/9780226852904.001.0001 · Cited by 923 · see citing works
Pretest-posttest designs and measurement of change
Dimitrov, D. M., & Rumrill, Jr. (2003) · WORK: A Journal of Prevention, Assessment & Rehabilitation · doi:10.3233/wor-2003-00285 · Cited by 908 · see citing works
Li, J. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.01.001 · Cited by 652 · see citing works
Wada, K., & Shibata, T. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.906261 · Cited by 583 · see citing works
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548 · see citing works
Moralizing technology: understanding and designing the morality of things
(2012) · Choice Reviews Online · doi:10.5860/choice.49-4425 · Cited by 527 · see citing works
The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents
Bainbridge, W. A., Hart, J., Kim, E. S., & Scassellati, B. M. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0082-7 · Cited by 478 · see citing works
A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453 · see citing works
Huck, S. W., & McLean, R. A. (1975) · Psychological Bulletin · doi:10.1037/h0076767 · Cited by 449 · see citing works
Social categorization of social robots: Anthropomorphism as a function of robot group membership
Eyssel, F., & Kuchenbrandt, D. (2012) · British Journal of Social Psychology · doi:10.1111/j.2044-8309.2011.02082.x · Cited by 360 · see citing works
Measurement of trust in human-robot collaboration
Freedy, A., deVisser, E., Weltman, G., & Coeyman, N. (2007) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2007.4621745 · Cited by 308 · see citing works
Sifting the evidence—what's wrong with significance tests?
Sterne, J. A. C., & Smith, G. D. (2001) · Physical Therapy · doi:10.1093/ptj/81.8.1464 · Cited by 301 · see citing works
de Graaf, M. M. A., Allouch, S. B., & Klamer, T. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.030 · Cited by 299 · see citing works
Bayesian tests to quantify the result of a replication attempt.
Verhagen, J., & Wagenmakers, E. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0036731 · Cited by 287 · see citing works
psiTurk: An open-source framework for conducting replicable behavioral experiments online
Gureckis, T. M., Martin, J. B., McDonnell, J. V., Rich, A. S., Markant, D. B., Coenen, A., Halpern, D., Hamrick, J. B., & Chan, P. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0642-8 · Cited by 256 · see citing works
Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents
Malle, B. F., Scheutz, M., Arnold, T., Voiklis, J., & Cusimano, C. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696458 · Cited by 246 · see citing works
Arkin, R. C. (2008) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1349822.1349839 · Cited by 236 · see citing works
The top 10 misconceptions about implicature
Bach, K. (2006) · Studies in language companion series · doi:10.1075/slcs.80.03bac · Cited by 227 · see citing works
Autonomous Military Robotics: Risk, Ethics, and Design
Lin, P. K., Bekey, G. A., & Abney, K. (2008) · doi:10.21236/ada534697 · Cited by 227 · see citing works
The crying shame of robot nannies: An ethical appraisal
Sharkey, N., & Sharkey, A. (2010) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.11.2.01sha · Cited by 223 · see citing works
Crowdsourcing Samples in Cognitive Science.
Stewart, N., Chandler, J. J., & Paolacci, G. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.06.007 · Cited by 210 · see citing works
First steps toward natural human-like HRI
Scheutz, M. J., Schermerhorn, P., Kramer, J., & Anderson, D. C. (2006) · Autonomous Robots · doi:10.1007/s10514-006-9018-3 · Cited by 181 · see citing works
(2015) · doi:10.1145/2696454.2696460 · Cited by 175 · see citing works
Do people hold a humanoid robot morally accountable for the harm it causes?
Kahn, P. H., Kanda, T., Ishiguro, H., Gill, B. T., Ruckert, J. H., Shen, S., Gary, H. E., Reichert, A. L., Freier, N. G., & Severson, R. L. (2012) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2157689.2157696 · Cited by 169 · see citing works
The crying shame of robot nannies: An ethical appraisal
SHARKEY, N. E., & SHARKEY, A. J. C. (2010) · PhilPapers (PhilPapers Foundation) · Cited by 146 · see citing works
Comparing groups in a before–after design: When t test and ANCOVA produce different results
Wright, D. B. (2006) · British Journal of Educational Psychology · doi:10.1348/000709905x52210 · Cited by 135 · see citing works
Understanding ordinary unethical behavior: why people who value morality act immorally
Francesca Gino, B. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.03.001 · Cited by 131 · see citing works
Replication Bayes factors from evidence updating
Ly, A., Etz, A. J., Marsman, M., & Wagenmakers, E. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1092-x · Cited by 110 · see citing works
Sorry, I Didn’t Catch That! An Investigation of Non-understanding Errors and Recovery Strategies
Bohus, D., & Rudnicky, A. I. (2018) · doi:10.1184/r1/6609683 · Cited by 109 · see citing works
Briggs, G., & Scheutz, M. J. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0235-1 · Cited by 86 · see citing works
Fischer, K., Lohan, K. S., & Foth, K. A. (2012) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2157689.2157839 · Cited by 86 · see citing works
The Need for Moral Competency in Autonomous Agent Architectures
Scheutz, M. J. (2016) · Synthese Library/Synthese library · doi:10.1007/978-3-319-26485-1_30 · Cited by 72 · see citing works
An Overview of the Distributed Integrated Cognition Affect and Reflection DIARC Architecture
Scheutz, M., Williams, T., Krause, E., Oosterveld, B., Sarathy, V., & Frasca, T. (2019) · Intelligent Systems, Control and Automation: Science and Engineering · doi:10.1007/978-3-319-97550-4_11 · Cited by 69 · see citing works
Self-citationUnified Pragmatic Models for Generating and Following Instructions
Fried, D., Andreas, J., & Klein, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1177 · Cited by 64 · see citing works
Williams, T., Briggs, G., Oosterveld, B., & Scheutz, M. J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9377 · Cited by 61 · see citing works
Self-citationTowards morally sensitive action selection for autonomous social robots
Scheutz, M., Malle, B., & Briggs, G. (2015) · 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2015.7333661 · Cited by 59 · see citing works
Nomura, T., Uratani, T., Kanda, T., Matsumoto, K., Kidokoro, H., Suehiro, Y., & Yamada, S. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts · doi:10.1145/2701973.2701977 · Cited by 58 · see citing works
Simmons, R., Makatchev, M., Kirby, R., Lee, M. K., Fanaswala, I., Browning, B., Forlizzi, J., & Sakr, M. (2011) · AI Magazine · doi:10.1609/aimag.v32i4.2383 · Cited by 54 · see citing works
Comparing Video, Avatar, and Robot Mediated Communication: Pros and Cons of Embodiment
Tanaka, K., Nakanishi, H., & Ishiguro, H. (2014) · Communications in computer and information science · doi:10.1007/978-3-662-44651-5_9 · Cited by 52 · see citing works
Toward Information Theoretic Human-Robot Dialog
Tellex, S., Thaker, P., Deits, R., Kollar, T., & Roy, N. (2012) · Robotics: Science and Systems · doi:10.15607/rss.2012.viii.052 · Cited by 49 · see citing works
Enabling Robots to Understand Indirect Speech Acts in Task-Based Interactions
Briggs, G., Williams, T., & Scheutz, M. J. (2017) · Journal of Human-Robot Interaction · doi:10.5898/jhri.6.1.briggs · Cited by 44 · see citing works
Self-citationChildren comply with a robot's indirect requests
Kennedy, J., Baxter, P. E., & Belpaeme, T. (2014) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2559636.2559820 · Cited by 41 · see citing works
Briggs, G., & Scheutz, M. J. (2015) · National Conference on Artificial Intelligence · Cited by 41 · see citing works
Grounded Language Learning: Where Robotics and NLP Meet
Matuszek, C. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/810 · Cited by 35 · see citing works
Grounded Language Learning: Where Robotics and NLP Meet
Matuszek, C. (2021) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m2fiye-fv1d · Cited by 32 · see citing works
"Thank You for Sharing that Interesting Fact!"
Williams, T., Thames, D., Novakoff, J., & Scheutz, M. J. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171246 · Cited by 30 · see citing works
Self-citationDempster-Shafer theoretic resolution of referential ambiguity
Williams, T., Yazdani, F., Suresh, P., Scheutz, M. J., & Beetz, M. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9795-5 · Cited by 20 · see citing works
Self-citationMiscommunication Recovery in Physically Situated Dialogue
Marge, M., & Rudnicky, A. I. (2015) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4604 · Cited by 16 · see citing works
Williams, T., & Scheutz, M. J. (2017) · doi:10.15607/rss.2017.xiii.017 · Cited by 15 · see citing works
Self-citationHe who hesitates is lost (...in thoughts over a robot)
Wen, J., Stewart, A., Billinghurst, M., Dey, A., Tossell, C. C., & Finomore, V. (2018) · Technology, Mind, and Society Conference (TechMindSociety) · doi:10.1145/3183654.3183703 · Cited by 14 · see citing works
Gervits, F., Briggs, G., & Scheutz, M. J. (2017) · eScholarship (California Digital Library) · Cited by 12 · see citing works
A Theoretical Model of Indirect Request Comprehension.
Trott, S., & Bergen, B. K. (2017) · National Conference on Artificial Intelligence · Cited by 9 · see citing works
A Bayesian Analysis of Moral Norm Malleability during Clarification Dialogues.
Williams, T., Jackson, R. B., & Lockshin, J. (2018) · eScholarship (California Digital Library) · Cited by 9 · see citing works
Self-citationRobot: Asker of questions and changer of norms?
(2018) · International Conference on Robot Ethics and Standards (ICRES) · doi:10.13180/icres.2018.20-21.08.014 · Cited by 8 · see citing works
Polite Interactions with Robots
Benotti, L., & Blackburn, P. (2016) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-708-5-293 · Cited by 6 · see citing works
Flagged first, then by citations
1 of the 71 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447 · see citing works
The ethical issues of social assistive robotics: A critical literature review
Boada, J. P., Maestre, B. R., & Carme Torras, A. (2021) · Technology in Society · doi:10.1016/j.techsoc.2021.101726 · Cited by 151 · see citing works
A Survey of Mental Modeling Techniques in Human–Robot Teaming
Tabrez, A., Luebbers, M. B., & Hayes, B. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00019-0 · Cited by 98 · see citing works
A Theory of Social Agency for Human-Robot Interaction
Jackson, R. B., & Williams, T. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.687726 · Cited by 76 · see citing works
Self-citationExploring the Role of Gender in Perceptions of Robotic Noncompliance
Jackson, R. B., Williams, T., & Smith, N. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3319502.3374831 · Cited by 69 · see citing works
Self-citationKim, B., Wen, R., Zhu, Q., Williams, T., & Phillips, E. K. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3446908 · Cited by 48 · see citing works
Self-citationEthics, Equity, & Justice in Human-Robot Interaction: A Review and Future Directions
Ostrowski, A. K., Walker, R., Das, M., Yang, M., Breazea, C., Park, H. W., & Verma, A. (2022) · 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/ro-man53752.2022.9900805 · Cited by 47 · see citing works
Blame-Laden Moral Rebukes and the Morally Competent Robot: A Confucian Ethical Perspective
Zhu, Q., Williams, T., Jackson, B., & Wen, R. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00246-w · Cited by 45 · see citing works
Self-citationA Scoping Review of Ethics Across SIGCHI
Vilaza, G. N., Doherty, K., McCashin, D., Coyle, D., Bardram, J. E., & Barry, M. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533511 · Cited by 43 · see citing works
Why and How Robots Should Say ‘No’
Briggs, G., Williams, T., Jackson, R. B., & Scheutz, M. J. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-021-00780-y · Cited by 29 · see citing works
Self-citationEnactive artificial intelligence: subverting gender norms in human-robot interaction
Hipólito, I., Winkle, K., & Lie, M. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1149303 · Cited by 27 · see citing works
A Psychological Need-Fulfillment Perspective for Designing Social Robots that Support Well-Being
Janssen, S., & Schadenberg, B. R. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01102-8 · Cited by 27 · see citing works
The Confucian Matador: Three Defenses Against the Mechanical Bull
Williams, T., Zhu, Q., Wen, R.-C., & de Visser, E. (2020) · IEEE/ACM International Conference on Human-Robot Interaction · doi:10.1145/3371382.3380740 · Cited by 28 · see citing works
Self-citationAppropriately Representing Military Tasks for Human-Machine Teaming Research
Tossell, C. C., Kim, B., Donadio, B. T., de Visser, E. J., Holec, R., & Phillips, E. K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59990-4_19 · Cited by 20 · see citing works
Robots for Social Justice (R4SJ): Toward a More Equitable Practice of Human-Robot Interaction
Zhu, Y., Wen, R., & Williams, T. (2024) · Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3610977.3634944 · Cited by 19 · see citing works
“…robots with intelligence [6, 14], social agency [28], moral agency [16, 52, 57], and the uniquely potent combination of these factors [27], robots may be accepted as informed community members (although cp. [7]), granting them an outsized potential for persuasion and infuence [26, 50, 53].”
BackgroundSelf-citationWilliams, T. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3580031 · Cited by 19 · see citing works
Self-citationGalatolo, A., Melsión, G. I., Leite, I., & Winkle, K. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00938-2 · Cited by 18 · see citing works
An Experimental Ethics Approach to Robot Ethics Education
Williams, T., Zhu, Q., & Grollman, D. H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7067 · Cited by 16 · see citing works
Self-citationA case study in designing trustworthy interactions: implications for socially assistive robotics
Zhong, M., Fraile, M., Castellano, G., & Winkle, K. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1152532 · Cited by 15 · see citing works
Enabling Morally Sensitive Robotic Clarification Requests
Jackson, R. B., & Williams, T. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3503795 · Cited by 15 · see citing works
Self-citationHuman perceptions of social robot deception behaviors: an exploratory analysis
Rosero, A., Dula, E., Kelly, H., Malle, B. F., & Phillips, E. K. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1409712 · Cited by 13 · see citing works
Comparing Strategies for Robot Communication of Role-Grounded Moral Norms
Wen, R., Kim, B., Phillips, E. K., Zhu, Q., & Williams, T. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3447185 · Cited by 12 · see citing works
Self-citation“Excuse Me, Robot”: Impact of Polite Robot Wakewords on Human-Robot Politeness
Williams, T., Grollman, D. H., Han, M., Jackson, R. B., Lockshin, J., Wen, R., Nahman, Z., & Zhu, Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_34 · Cited by 12 · see citing works
Self-citationThe seven troubles with norm-compliant robots
Coggins, T. N., & Steinert, S. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09701-1 · Cited by 11 · see citing works
Voice in the Machine: Ethical Considerations for Language-Capable Robots
Williams, T., Matuszek, C., Jokinen, K., Korpan, R., Pustejovsky, J., & Scassellati, B. (2023) · Communications of the ACM · doi:10.1145/3604632 · Cited by 11 · see citing works
Self-citationImplicit Communication Through Social Distancing
Banisetty, S. B., & Williams, T. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3447222 · Cited by 10 · see citing works
Self-citationMaking moral decisions with artificial agents as advisors. A fNIRS study
Fabre, E. F., Mouratille, D., Bonnemains, V., Palmiotti, G. P., & Causse, M. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100096 · Cited by 9 · see citing works
Wen, R., Hanson, A., Han, Z., & Williams, T. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568162.3576959 · Cited by 9 · see citing works
Self-citationAn Integrated Approach to Context-Sensitive Moral Cognition in Robot Cognitive Architectures
Jackson, R. B., Li, S., Banisetty, S. B., Siva, S., Zhang, H., Dantam, N. T., & Williams, T. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636434 · Cited by 9 · see citing works
Self-citationKim, B., Wen, R., de Visser, E. J., Tossell, C. C., Zhu, Q., Williams, T., & Phillips, E. K. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103217 · Cited by 8 · see citing works
Self-citationHere’s Looking at You, Robot: The Transparency Conundrum in HRI
Lee, M., Ruijten, P. A. M., Frank, L. E., & IJsselsteijn, W. A. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309653 · Cited by 8 · see citing works
Perceptions of Agent Loyalty with Ancillary Users
Reig, S., Carter, E. J., Tan, X. Z., Steinfeld, A. M., & Forlizzi, J. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00725-x · Cited by 8 · see citing works
Confrontation and Cultivation: Understanding Perspectives on Robot Responses to Norm Violations
Mott, T., & Williams, T. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309577 · Cited by 7 · see citing works
Self-citationMott, T., Fanganello, A., & Williams, T. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610977.3634943 · Cited by 7 · see citing works
Self-citationCotter, J. E., O’Hear, E. H., Smitherman, R. C., Bright, A. B., Tenhundfeld, N. L., Forsyth, J. B., Sprague, N. R., & El-Tawab, S. (2022) · Systems and Information Engineering Design Symposium · doi:10.1109/sieds55548.2022.9799431 · Cited by 7 · see citing works
Goo, H. G., Winkle, K., Williams, T., & Strait, M. K. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309640 · Cited by 6 · see citing works
Self-citationHanson, A., Starr, N. D., Emnett, C. Z., Wen, R., Malle, B. F., & Williams, T. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610977.3634942 · Cited by 6 · see citing works
Self-citationRobots Are Moral Actors: Unpacking Current Moral HRI Research Through a Moral Foundations Lens
Doyle-Burke, D., & Haring, K. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_15 · Cited by 6 · see citing works
Wen, R., Barton, B., Fauré, S., & Williams, T. (2022) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3536221.3556615 · Cited by 5 · see citing works
Self-citationMadureira, B., & Schlangen, D. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.169 · Cited by 5 · see citing works
Conformity and Trust in Multi-party vs. Individual Human-Robot Interaction
Kamelabad, A. M., Engwall, O., & Skantze, G. (2024) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3652988.3673954 · Cited by 5 · see citing works
Muhsyanur, M., Larisu, Z., Sanulita, H., Ertanti, D. W., & Widada, D. M. (2021) · Linguistics and Culture Review · doi:10.21744/lingcure.v6n1.1942 · Cited by 6 · see citing works
Systematic methods for Moral HRI: Studying human responses to robot norm conflictsPreprint
Phillips, E. J., Malle, B. F., Rosero, A., Kim, M. J., Kim, B., Melles, L., & Chi, V. B. (2023) · doi:10.31234/osf.io/by4rh · Cited by 5 · see citing works
Zhu, Y., Brush, C., & Williams, T. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731244 · Cited by 4 · see citing works
Self-citationHow to Tune Your Draggin’: Can Body Language Mitigate Face Threat in Robotic Noncompliance?
Naughton, A., & Williams, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90525-5_21 · Cited by 4 · see citing works
Self-citationRube-Goldberg Machines, Transparent Technology, and the Morally Competent Robot
Mott, T., & Williams, T. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3580163 · Cited by 4 · see citing works
Self-citationDegrees of Freedom: A Storytelling Game that Supports Technology Literacy about Social Robots
Mott, T., Higger, M., Bejarano, A., & Williams, T. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731340 · Cited by 3 · see citing works
Self-citationSchadenberg, B. R., Sainz, J. D., Kolkmeier, J., Goo, H. G., & Evers, V. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719793 · Cited by 3 · see citing works
Evaluating the morality of violence against robots
Archer, J., Wilks, M., & Sommer, K. (2025) · Scientific Reports · doi:10.1038/s41598-025-24875-y · Cited by 3 · see citing works
Understanding the spirit of a norm: Challenges for norm‐learning agents
Arnold, T., & Scheutz, M. J. (2023) · AI Magazine · doi:10.1002/aaai.12138 · Cited by 3 · see citing works
Service Robot Morality in Customer–Robot Interactions: A Mixed-Methods Study
Kegel, M. M., Stock‐Homburg, R., & Tuunanen, T. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3706067 · Cited by 3 · see citing works
Can Robots Be Used to Encourage Social Distancing?
McCaffrey, C., Taylor, A., Roy, S., Banisetty, S. B., Mead, R., & Williams, T. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3447217 · Cited by 3 · see citing works
Self-citationI Need Your Advice... Human Perceptions of Robot Moral Advising BehaviorsPreprint
Starr, N. D., Malle, B. F., & Williams, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06963 · Cited by 3 · see citing works
Self-citationGPT-4 as a Moral Reasoner for Robot Command Rejection
Wen, R.-C., Ferraro, F., & Matuszek, C. (2024) · International Conference on Human-Agent Interaction · doi:10.1145/3687272.3688319 · Cited by 5 · see citing works
Perspectives on Moral Agency in Human-Robot Interaction
Kim, B., Phillips, E. K., Williams, T., & Zhu, Q. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3579966 · Cited by 2 · see citing works
Self-citationOn Further Reflection... Moral Reflections Enhance Robotic Moral Persuasive Capability
Wen, R., Kim, B., Phillips, E. K., Zhu, Q., & Williams, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30933-5_19 · Cited by 2 · see citing works
Self-citationSöderlund, M. (2025) · Services Marketing Quarterly · doi:10.1080/15332969.2025.2579465 · Cited by 1 · see citing works
Mott, T., Smith, C., Fanganello, A., & Williams, T. (2026) · International Journal of Social Robotics · doi:10.1007/s12369-025-01343-1 · Cited by 1 · see citing works
Self-citationEXPLORING THE EFFECTIVENESS OF BODY LANGUAGE IN MITIGATING THE FACE THREAT OF ROBOT NONCOMPLIANCE
Naughton, A. (2021) · Digital Collections of Colorado (Colorado State University)
Theoretical Considerations for Social Learning between a Human Observer and a Robot Model
Kim, B., & Phillips, E. K. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651264
Agarwal, C., & Krishnaswamy, V. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2639098
Modeling the Social and Normative Context of Human–Agent Interactions
Vázquez, M., Güneş, H., Williams, T., & Jackson, R. B. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.013
Self-citationFiebrink, R., Gillies, M. F. P., & Ramos, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.010
- Authors
- Jackson, R. B., & Williams, T.
- Affiliations
- Colorado School of Mines (US)
- Venue
- 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2019-03
- Pages
- 401-410
- OpenAlex
- W2933500682
- Cited by
- 64
- References
- 71
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 12 · 2023: 15 · 2022: 6 · 2021: 15 · 2020: 8 · 2019: 1
- FWCI
- 12.38
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- moral psychology, human-robot interaction, dialogue systems, robot communication, robot architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
