Effects of Anthropomorphism and Accountability on Trust in Human Robot Interaction
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
This paper examines how people’s trust and dependence on robot teammates providing decision support varies as a function of different attributes of the robot, such as perceived anthropomorphism, type of support provided by the robot, and its physical presence. We conduct a mixed-design user study with multiple robots to investigate trust, inappropriate reliance, and compliance measures in the context of a time-constrained game. We also examine how the effect of human accountability addresses errors due to over-compliance in the context of human robot interaction (HRI). This study is novel as it involves examining multiple attributes at once, thus enabling us to perform multi-way comparisons between different attributes on trust and compliance with the agent. Results from the 4×4×2×2 study show that behavior and anthropomorphism of the agent are the most significant factors in predicting the trust and compliance with the robot. Furthermore, adding a coalition-building preface, where the agent provides context to why it might make errors while giving advice, leads to an increase in trust for specific behaviors of the agent.CCS CONCEPTS • Human-centered computing $\rightarrow$ User studies; • Computer systems organization $\rightarrow$ Robotics. ACM Reference Format: Manisha Natarajan and Matthew Gombolay. 2020. Effects of Anthropomorphism and Accountability on Trust in Human Robot Interaction. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interacti…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“anthropomorphism is positively correlated with trust in robots solving arithmetic problems11, in chatbots on e-commerce platforms12, and in AI solutions to an image classification task13.”
From The influence of mental state attributions on trust in large language models (2025) · cites this paper as [11]
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“Past works [21, 35] have shown that such errors can be meliorated by including operator accountability.”
BackgroundBartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193 · cited 2×
“continuum adapted from the anthropomorphism Godspeed questionnaire in [2].”
BackgroundMethodA Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“Hancock et al. classify factors impacting trust in HRI as robot-related (performance-based, attribute-based), human-related (ability, human characteristic), and environmental (team collaboration and task-based factors) [14].”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799 · cited 1×
“In this study, trust was assessed using a 7-point Likert scale questionnaire adapted from [19], administered to the subjects at the end of each agent.”
MethodAnthropomorphism and the social robot
Duffy, B. R. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00374-3 · Cited by 1,447 · cited 2×
“Multiple studies in the past have shown that the anthropomorphism of an agent elicits a positive response from the subjects [7, 10].”
BackgroundThe mind in the machine: Anthropomorphism increases trust in an autonomous vehicle
Waytz, A., Heafner, J., & Epley, N. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.01.005 · Cited by 1,439 · cited 2×
“Task performance has proven to be a significant factor in contributing towards trust in automation [40] and robots [32, 33, 38].”
BackgroundProceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,432
Similarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577 · cited 1×
“As machines become increasingly autonomous, the role of a human operator has metamorphosed from that of a primary controller to an active teammate who shares control with automation [24].”
BackgroundSalem, M., Lakatos, G., Amirabdollahian, F., & Dautenhahn, K. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696497 · Cited by 494
The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents
Bainbridge, W. A., Hart, J. W., Kim, E. S., & Scassellati, B. (2011) · International Journal of Social Robotics · doi:10.1007/s12369-010-0082-7 · Cited by 478 · cited 4×
“The physical presence of a robot is perceived to be more compelling and previous works [1, 13, 30] have proven that user’s compliance is higher for embodied agents.”
BackgroundInfluentialAnthropomorphism and human likeness in the design of robots and human-robot interaction
Fink, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34103-8_20 · Cited by 455
Comparing a computer agent with a humanoid robot
Powers, A., Kiesler, S., Fussell, S., & Torrey, C. (2007) · Proceedings of the ACM/IEEE international conference on Human-robot interaction · doi:10.1145/1228716.1228736 · Cited by 341 · cited 5×
“User’s perceptions have been shown to vary with physical and virtual robots [1, 13, 30] and user’s trust is dependent on several other quantities, such as user experience [43] and task performance [5, 32].”
BackgroundInfluentialInternational Journal of Social Robotics
(2013) · International Journal of Social Robotics · doi:10.1007/12369.1875-4805 · Cited by 313
Eyssel, F., Kuchenbrandt, D., Bobinger, S., de Ruiter, L., & Hegel, F. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157717 · Cited by 307 · cited 2×
“Studies in the past have shown that anthropomorphism affects trust favorably in automation [40] and robots [9, 27, 37].”
BackgroundHow anthropomorphism affects empathy toward robots
Riek, L. D., Rabinowitch, T.-C., Chakrabarti, B., & Robinson, P. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514158 · Cited by 307 · cited 2×
“Anthropomorphism has also been shown to increase the user’s empathy toward the robot [31].”
BackgroundThe role of physical embodiment in human-robot interaction
Wainer, J., Feil-seifer, D., Shell, D., & Mataric, M. (2006) · ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2006.314404 · Cited by 292 · cited 2×
“Embodied robots have been proven to have stronger influence on user performance over virtual robots and also improve the quality of interaction as perceived by the user [1, 13, 30, 39].”
BackgroundThe Role of Trust in Human-Robot Interaction
Lewis, M., Sycara, K., & Walker, P. (2018) · Studies in Systems, Decision and Control · doi:10.1007/978-3-319-64816-3_8 · Cited by 281 · cited 2×
“Therefore, the role of trust in human robot interactions is more complex and difficult to understand [23].”
BackgroundMethodDixon, S. R., & Wickens, C. D. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006778606822 · Cited by 280 · cited 1×
“Type II error refers to under-reliance or rejecting high-quality advice from the agent [6].”
BackgroundDecision-making authority, team efficiency and human worker satisfaction in mixed human–robot teams
Gombolay, M. C., Gutierrez, R. A., Clarke, S. G., Sturla, G. F., & Shah, J. A. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9457-9 · Cited by 256 · cited 1×
“The authors in [11, 12] state that human workers prefer to give robots higher control authority in scheduling tasks.”
BackgroundSelf-citationThe dynamics of trust: Comparing humans to automation.
Lewandowsky, S., Mundy, M., & Tan, G. P. A. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.2.104 · Cited by 240 · cited 1×
“Studies on human social psychology [22] state that trust is a dynamic process and thus it is critical to understand how user’s trust and dependence on the agent vary, especially when they encounter errors.”
BackgroundPhillips, E., Zhao, X., Ullman, D., & Malle, B. F. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171268 · Cited by 233 · cited 1×
“Prior work has shown that increased anthropomorphism of a robot or a software agent leads to a more positive interaction experience [7, 29].”
BackgroundAutomation- Induced "Complacency": Development of the Complacency-Potential Rating Scale
Singh, I. L., Molloy, R., & Parasuraman, R. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0302_2 · Cited by 219 · cited 2×
“The subject’s bias on automation is measured using a 7-point Likert scale adapted from [36].”
MethodEvaluating Effects of User Experience and System Transparency on Trust in Automation
Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020230 · Cited by 208 · cited 1×
“User’s perceptions have been shown to vary with physical and virtual robots [1, 13, 30] and user’s trust is dependent on several other quantities, such as user experience [43] and task performance [5, 32].”
Backgroundde Visser, E., & Parasuraman, R. (2011) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411410160 · Cited by 207
Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations
Robinette, P., Howard, A. M., & Wagner, A. R. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2648849 · Cited by 205 · cited 4×
“User’s perceptions have been shown to vary with physical and virtual robots [1, 13, 30] and user’s trust is dependent on several other quantities, such as user experience [43] and task performance [5, 32].”
BackgroundInfluentialGombolay, M., Bair, A., Huang, C., & Shah, J. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916688255 · Cited by 192
Self-citationTrust in socially assistive robots: Considerations for use in rehabilitation
Langer, A., Feingold-Polak, R., Mueller, O., Kellmeyer, P., & Levy-Tzedek, S. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.014 · Cited by 178
Automated diagnostic aids: The effects of aid reliability on users' trust and reliance
Wiegmann, D. A., Rich, A., & Zhang, H. (2001) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220110110306 · Cited by 176 · cited 1×
“Trust between humans is different from human-automation trust as humans perceive automated systems to be more credible and are hence much more sensitive to errors made by automation [8, 41].”
BackgroundDo Robot Performance and Behavioral Style affect Human Trust? A Multi-Method Approach
van den Brule, R., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., & Haselager, P. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0231-5 · Cited by 160 · cited 1×
“Task performance has proven to be a significant factor in contributing towards trust in automation [40] and robots [32, 33, 38].”
BackgroundImpact of robot failures and feedback on real-time trust
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A. M., & Yanco, H. A. (2013) · doi:10.5555/2447556.2447663 · Cited by 139
Predicting Misuse and Disuse of Combat Identification Systems
Dzindolet, M. T., Pierce, L. G., Beck, H. P., Dawe, L. A., & Anderson, B. W. (2001) · Military Psychology · doi:10.1207/s15327876mp1303_2 · Cited by 138
Tell me more designing HRI to encourage more trust, disclosure, and companionship
Martelaro, N., Nneji, V. C., Ju, W., & Hinds, P. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451750 · Cited by 124 · cited 1×
“[25] talks about how expressive ability and vulnerability of robots can affect trust.”
Background“I Don't Believe You”: Investigating the Effects of Robot Trust Violation and Repair
Sebo, S. S., Krishnamurthi, P., & Scassellati, B. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673169 · Cited by 110 · cited 1×
“Sebo et al. discuss trust violation versus trust repair strategies in the context of a competitive game between the human and the robot [34].”
BackgroundAutomation use and automation bias
Mosier, K. L., & Skitka, L. J. (1999) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129904300346 · Cited by 69 · cited 1×
“For instance, the Aviation Safety Reporting System contains multiple reports from pilots associating failures to excessive trust in the autopilot system [28].”
BackgroundDo You Trust Me, Blindly? Factors Influencing Trust Towards a Robot Recommender System
Herse, S., Vitale, J., Tonkin, M., Ebrahimian, D., Ojha, S., Johnston, B., Judge, W., & Williams, M.-A. (2018) · 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2018.8525581 · Cited by 61 · cited 1×
“The authors in [17] explore the factors that affect robot recommendation systems, primarily testing preference elicitation of the agent.”
BackgroundMathur, M. B., & Reichling, D. B. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514192 · Cited by 48 · cited 1×
“Studies in the past have shown that anthropomorphism affects trust favorably in automation [40] and robots [9, 27, 37].”
BackgroundThe Ultimatum Game as Measurement Tool for Anthropomorphism in Human–Robot Interaction
Torta, E., van Dijk, E., Ruijten, P. A. M., & Cuijpers, R. H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-319-02675-6_21 · Cited by 43 · cited 1×
“Studies in the past have shown that anthropomorphism affects trust favorably in automation [40] and robots [9, 27, 37].”
BackgroundAgent Appearance Modulates Mind Attribution and Social Attention in Human-Robot Interaction
Martini, M. C., Buzzell, G. A., & Wiese, E. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25554-5_43 · Cited by 38 · cited 1×
“Further, [26] reports that the gaze of a robot (i.e., whether or not the agent maintains eye-contact with the human) can also affect the perceived anthropomorphism.”
BackgroundRobotic Assistance in Coordination of Patient Care
Gombolay, M., Yang, X. J., Hayes, B., Seo, N., Liu, Z., Wadhwania, S., Yu, T., Shah, N. T., Golen, T. H., & Shah, J. (2016) · Robotics: Science and Systems · doi:10.15607/rss.2016.xii.026 · Cited by 33 · cited 5×
“analyze how robotic assistants can be effectively employed to assist nurses in patient care [13].”
BackgroundInfluentialSelf-citationA Robot Barista Comments on its Clients: Social Attitudes Toward Robot Data Use
Hedaoo, S., Williams, A., Wadgaonkar, C., & Knight, H. (2019) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673021 · Cited by 27 · cited 1×
“In [16], a user study was conducted to analyze how people react to positive and negative comments directed at them by a robot barista.”
BackgroundXu, J. C., Bryant, D. G., & Howard, A. M. (2018) · IEEE RO-MAN · doi:10.1109/roman.2018.8525782 · Cited by 26 · cited 1×
“[18, 20, 42] examine trust between humans and a robot therapist providing rehabilitative interventions.”
BackgroundRobot Authority in Human-Machine Teams: Effects of Human-Like Appearance on Compliance
Haring, K. S., Mosley, A., Pruznick, S., Fleming, J., Satterfield, K., de Visser, E. J., Tossell, C. C., & Funke, G. J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21565-1_5 · Cited by 26 · cited 1×
“Further, works such as [3, 15] show how robot appearance affects user compliance.”
BackgroundThe authority of appearance: How robot features influence trait inferences and evaluative responses
Benitez, J., Wyman, A. B., Carpinella, C. M., & Stroessner, S. J. (2017) · IEEE RO-MAN · doi:10.1109/roman.2017.8172333 · Cited by 23 · cited 1×
“Further, works such as [3, 15] show how robot appearance affects user compliance.”
BackgroundShah, S., & Bliss, J. P. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601530 · Cited by 16 · cited 1×
“Past works [21, 35] have shown that such errors can be meliorated by including operator accountability.”
BackgroundMaintaining Trust While Fixated to a Rehabilitative Robot
Jensen, L. U., Winther, T. S., Jørgensen, R. N., Hellestrup, D. M., & Jensen, L. C. (2016) · doi:10.5555/2906831.2906918 · Cited by 1
Research works printed but not linked: 11
- Bartneck Christoph, 2008, International Journal of Social Robotics 1 (01
- Eyssel F., 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 125--126
- Fink Julia, Social Robotics, Shuzhi Sam Ge, Oussama Khatib, John-John Cabibihan, Reid Simmons, and Mary-Anne Williams (Eds.)
- Jian Jiun-Yin, 2000, International Journal of Cognitive Ergonomics 4 (03
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- Mathur M. B., 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 313--314
- Kathleen, 1999, Proceedings of the Human Factors and Ergonomics Society Annual Meeting 43
- Phillips Elizabeth, Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (HRI '18)
- Riek L. D., 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 245--246
- Xu J., 2018, Validating the Equivalency of Trust in Human-Robot Healthcare Scenarios. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). 442--447
- Yang X. Jessie, 2023, Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI '17)
Cited by
The most human bot: Female gendering increases humanness perceptions of bots and acceptance of AI
Borau, S., Otterbring, T., Laporte, S., & Fosso Wamba, S. (2021) · Psychology & Marketing · doi:10.1002/mar.21480 · Cited by 272
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
“9% e.g. game points [154, 244–246]), negative virtual consequences for participants ( 𝑛 = 29, 44 .”
Trust in Robots: Challenges and Opportunities
Kok, B. C., & Soh, H. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00029-y · Cited by 221
“The same goes for robots — people often judge a robot ’ s trustworthiness based on its physical appearance [11, 31 – 33].”
BackgroundKim, J., & Im, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107512 · Cited by 220
How anthropomorphism affects trust in intelligent personal assistants
Chen, Q. Q., & Park, H. J. (2021) · Industrial Management & Data Systems · doi:10.1108/imds-12-2020-0761 · Cited by 140
Metadata
- Authors
- Natarajan, M., & Gombolay, M.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
- Publisher
- ACM
- Published
- 2020-03-09
- Pages
- 33-42
- OpenAlex
- W3009894005
- Cited by
- 248
- References
- 49
- Citations by year
- 2026: 18 · 2025: 57 · 2024: 63 · 2023: 40 · 2022: 41 · 2021: 20 · 2020: 7
- FWCI
- 38.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- Georgia Tech Institutional Funding
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- human-robot interaction, trust in robots, anthropomorphism, human accountability, decision support, robot behavior, coalition building, multi-agent robots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.