Overtrust of robots in emergency evacuation scenarios
Abstract
Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Poor trust calibration sometimes causes serious safety issues.
“Poor trust calibration sometimes causes serious safety issues [3, 4].”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [4]
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · see citing works
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1× · see citing works
“Hancock et al. performed a meta-analysis over the existing human-robot trust literature identifying 11 relevant research articles and found that, for these papers, robot performance is most strongly associated with trust [7].”
BackgroundSalem, M., Lakatos, G., Amirabdollahian, F., & Dautenhahn, K. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696497 · Cited by 494 · see citing works
The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents
Bainbridge, W. A., Hart, J., Kim, E. S., & Scassellati, B. M. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0082-7 · Cited by 478 · see citing works
Trust and etiquette in high-criticality automated systems
Parasuraman, R., & Miller, C. A. (2004) · Communications of the ACM · doi:10.1145/975817.975844 · Cited by 311 · see citing works
Impact of robot failures and feedback on real-time trust
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H. (2013) · 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483596 · Cited by 234 · see citing works
Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations
Robinette, P., Howard, A. M., & Wagner, A. R. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2648849 · Cited by 205 · see citing works
Self-citationReport of the technical investigation of The Station nightclub fire
Grosshandler, W. L., Bryner, N. P., Madrzykowski, D. M., & Kuntz, K. (2005) · doi:10.6028/nist.ncstar.2v1 · Cited by 148 · see citing works
Timing Is Key for Robot Trust Repair
Robinette, P., Howard, A. M., & Wagner, A. R. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-25554-5_57 · Cited by 121 · see citing works
Self-citationHuman behaviour in fire: the development and maturity of a scholarly study area
Bryan, J. L. (1999) · Fire and Materials · doi:10.1002/(sici)1099-1018(199911/12)23:6 · Cited by 60 · see citing works
Human Behavior In The World Trade Center Evacuation
Fahy, R. F., & Proulx, G. (1997) · Fire Safety Science · doi:10.3801/iafss.fss.5-713 · Cited by 55 · see citing works
Insights toward robot-assisted evacuation
Shell, D. A., & Matarić, M. J. (2005) · Advanced Robotics · doi:10.1163/1568553055011483 · Cited by 44 · see citing works
Information propagation applied to robot-assisted evacuation
Robinette, P., Vela, P. A., & Howard, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225122 · Cited by 28 · see citing works
Self-citationAssessment of robot guidance modalities conveying instructions to humans in emergency situations
Robinette, P., Wagner, A. R., & Howard, A. (2014) · IEEE RO-MAN · doi:10.1109/roman.2014.6926390 · Cited by 27 · see citing works
Self-citationModeling the Impact of Operator Trust on Performance in Multiple Robot Control
Gao, F., Clare, A. S., Macbeth, J., & Cummings, M. L. (2013) · Smith ScholarWorks (Smith College) · Cited by 23 · see citing works
Wagner, A. R., & Robinette, P. (2015) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.16.1.05wag · Cited by 14 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face Recognition
Sharif, M., Bhagavatula, S., Bauer, L., & Reiter, M. K. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978392 · Cited by 1,530 · see citing works
Vaithilingam, P., Zhang, T., & Glassman, E. L. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519665 · Cited by 660 · see citing works
Corporate digital responsibility
Lobschat, L., Mueller, B., Eggers, F., Brandimarte, L., Diefenbach, S., Kroschke, M., & Wirtz, J. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2019.10.006 · Cited by 573 · see citing works
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447 · see citing works
Honig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338 · see citing works
“…et al., 2015; Law et al., 2017), future contact intensions with the robot (Short et al., 2010; Salem et al., 2013, 2015; Brooks et al., 2016; Robinette et al., 2016; Kwon et al., 2018), the robot being a good teammate (Kwon et al., 2018), psychological closeness with the robot (Salem et…”
BackgroundMethodInfluentialThe role of trust in human-robot interaction
Lewis, M., Sycara, K., & Walker, P. M. (2018) · Studies in systems, decision and control · doi:10.1007/978-3-319-64816-3_8 · Cited by 298 · see citing works
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277 · see citing works
Adaptive trust calibration for human-AI collaboration
Okamura, K., & Yamada, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229132 · Cited by 239 · see citing works
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229 · see citing works
An Introduction to Ethics in Robotics and AI
Bartneck, C., Lütge, C., Wagner, A. R., & Welsh, S. (2020) · SpringerBriefs in ethics · doi:10.1007/978-3-030-51110-4 · Cited by 248 · see citing works
Self-citationTrust in Robots: Challenges and Opportunities
Kok, B. C., & Soh, H. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00029-y · Cited by 227 · see citing works
Kieslich, K., Keller, B., & Starke, C. (2022) · Big Data & Society · doi:10.1177/20539517221092956 · Cited by 232 · see citing works
Evaluating Effects of User Experience and System Transparency on Trust in Automation
Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020230 · Cited by 208 · see citing works
Bad machines corrupt good morals
Köbis, N., Bonnefon, J., & Rahwan, I. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01128-2 · Cited by 209 · see citing works
Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations
Robinette, P., Howard, A. M., & Wagner, A. R. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2648849 · Cited by 205 · see citing works
Self-citationThe use of social robots in classrooms: A review of field-based studies
Woo, H., LeTendre, G. K., Pham-Shouse, T., & Xiong, Y. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100388 · Cited by 183 · see citing works
Trust in socially assistive robots: Considerations for use in rehabilitation
Langer, A., Feingold-Polak, R., Mueller, O., Kellmeyer, P., & Levy‐Tzedek, S. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.014 · Cited by 179 · see citing works
Trusting Virtual Agents: The Effect of Personality
Zhou, M. X., Mark, G., Li, J., & Yang, H. (2019) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3232077 · Cited by 176 · see citing works
Keding, C., & Meissner, P. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.120970 · Cited by 168 · see citing works
Harms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149 · see citing works
“Similarly, Robinette et al. [2016] examines (over)trust of autonomous systems and find in emergency situations, people will follow robots into further danger, because they attribute the agency of the robot to the (assumed capable and responsible) designers.”
BackgroundModeling and Predicting Trust Dynamics in Human–Robot Teaming: A Bayesian Inference Approach
Guo, Y., & Yang, X. J. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00703-3 · Cited by 141 · see citing works
Individual differences in human–machine trust: A multi-study look at the perfect automation schema
Lyons, J. B., & Guznov, S. (2018) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2018.1491071 · Cited by 91 · see citing works
Are friends electric? The benefits and risks of human-robot relationships
Prescott, T. J., & Robillard, J. M. (2020) · iScience · doi:10.1016/j.isci.2020.101993 · Cited by 111 · see citing works
Guided crowd evacuation: approaches and challenges
Zhou, M., Dong, H., Ioannou, P., Zhao, Y., & Wang, F. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911672 · Cited by 110 · see citing works
Human–robot similarity and willingness to work with a robotic co-worker
You, S., & Robert Jr., L. P. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171281 · Cited by 118 · see citing works
Humanization of robots: Is it really such a good idea?
Giger, J., Piçarra, N. J. G., Alves‐Oliveira, P., Oliveira, R., & Arriaga, P. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.147 · Cited by 108 · see citing works
Modeling Trust in Human-Robot Interaction: A Survey
Khavas, Z. R., Ahmadzadeh, R., & Robinette, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_44 · Cited by 105 · see citing works
Self-citationTaxonomy of Trust-Relevant Failures and Mitigation Strategies
Tolmeijer, S., Weiss, A., Hanheide, M., Lindner, F., Powers, T. M., Dixon, C., & Tielman, M. L. (2020) · Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3319502.3374793 · Cited by 103 · see citing works
Impact of Anthropomorphic Robot Design on Trust and Attention in Industrial Human-Robot Interaction
Onnasch, L., & Hildebrandt, C. L. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3472224 · Cited by 103 · see citing works
A Review on Human–Machine Trust Evaluation: Human-Centric and Machine-Centric Perspectives
Gebru, B., Zeleke, L., Blankson, D., Nabil, M., Nateghi, S., Homaifar, A., & Tunstel, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3144956 · Cited by 101 · see citing works
Explainable Robotics in Human-Robot Interactions
Setchi, R., Dehkordi, M. B., & Khan, J. S. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.198 · Cited by 101 · see citing works
Ethics in human–AI teaming: principles and perspectives
Pflanzer, M., Traylor, Z., Lyons, J. B., Dubljević, V., & Nam, C. S. (2022) · AI and Ethics · doi:10.1007/s43681-022-00214-z · Cited by 106 · see citing works
Martinetti, A., Chemweno, P. K., Nizamis, K., & Fosch‐Villaronga, E. (2021) · Frontiers in Chemical Engineering · doi:10.3389/fceng.2021.666237 · Cited by 96 · see citing works
Trust in humans and robots: Economically similar but emotionally different
Schniter, E., Shields, T. W., & Sznycer, D. (2020) · Journal of Economic Psychology · doi:10.1016/j.joep.2020.102253 · Cited by 89 · see citing works
Aroyo, A. M., Rea, F., Sandini, G., & Sciutti, A. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2856272 · Cited by 85 · see citing works
Huo, W., Zheng, G., Yan, J., Sun, L., & Han, L. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107253 · Cited by 89 · see citing works
Booth, S., Tompkin, J., Pfister, H., Waldo, J., Gajos, K. Z., & Nagpal, R. (2017) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2909824.3020211 · Cited by 84 · see citing works
Multi-task trust transfer for human–robot interaction
Soh, H., Xie, Y., Chen, M., & Hsu, D. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919866905 · Cited by 84 · see citing works
Overtrusting robots: Setting a research agenda to mitigate overtrust in automation
Aroyo, A. M., de Bruyne, J., Dheu, O., Fosch‐Villaronga, E., Gudkov, A., Hoch, H., Jones, S., Lutz, C., Sætra, H. S., Solberg, M., et al. (2021) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2021-0029 · Cited by 80 · see citing works
Trust and Distrust of Automated Parking in a Tesla Model X
Tenhundfeld, N. L., de Visser, E. J., Ries, A. J., Finomore, V. S., & Tossell, C. C. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819865412 · Cited by 78 · see citing works
Robotic assistance in the coordination of patient care
Gombolay, M., Yang, X. J., Hayes, B., Seo, N., Liu, Z., Wadhwania, S., Yu, T., Shah, N. T., Golen, T. H., & Shah, J. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918778344 · Cited by 75 · see citing works
Cheon, E., & Su, N. M. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171244 · Cited by 75 · see citing works
Can You Trust Your Trust Measure?
Chita-Tegmark, M., Law, T., Rabb, N., & Scheutz, M. J. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434073.3444677 · Cited by 73 · see citing works
Measuring trust in artificial intelligence: validation of an established scale and its short form
McGrath, M. J., Lack, O., Tisch, J., & Duenser, A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1582880 · Cited by 73 · see citing works
Rossi, A., Dautenhahn, K., Koay, K. L., & Walters, M. L. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70022-9_5 · Cited by 71 · see citing works
Ullrich, D., Butz, A. M., & Diefenbach, S. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.554578 · Cited by 72 · see citing works
Explainable recommendation: when design meets trust calibration
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2021) · World Wide Web · doi:10.1007/s11280-021-00916-0 · Cited by 68 · see citing works
“Such faulty design has shown critical safety issues [68].”
BackgroundSecurity Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities
Neupane, S., Mitra, S., Fernandez, I. A., Saha, S., Mittal, S., Chen, J., Pillai, N., & Rahimi, S. (2024) · IEEE Access · doi:10.1109/access.2024.3363657 · Cited by 82 · see citing works
Are we behaviorally immune to COVID-19 through robots?
Xiong, X., Wong, I. A., & Yang, F. X. (2021) · Annals of Tourism Research · doi:10.1016/j.annals.2021.103312 · Cited by 67 · see citing works
The Illusion of Control: Placebo Effects of Control Settings
Vaccaro, K., Huang, D., Eslami, M., Sandvig, C., Hamilton, K., & Karahalios, K. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173590 · Cited by 65 · see citing works
Saunderson, S., & Nejat, G. (2021) · Science Robotics · doi:10.1126/scirobotics.abd5186 · Cited by 65 · see citing works
Cawthorne, D., & van Wynsberghe, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00233-1 · Cited by 60 · see citing works
Social robot deception and the culture of trust
Sætra, H. S. (2021) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2021-0021 · Cited by 59 · see citing works
Embodiment Effects in Interactions with Failing Robots
Kontogiorgos, D., van Waveren, S., Wallberg, O., Pereira, A., Leite, I., & Gustafson, J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376372 · Cited by 58 · see citing works
Choung, H., Seberger, J. S., & David, P. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2266244 · Cited by 67 · see citing works
Schneider, S., & Kümmert, F. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00629-w · Cited by 56 · see citing works
The societal impact of the metaverse
Henz, P. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00032-6 · Cited by 56 · see citing works
Collection of Metaphors for Human-Robot Interaction
Alves‐Oliveira, P., Lupetti, M. L., Luria, M., Löffler, D., Gamboa, M., Albaugh, L., Kamino, W., Ostrowski, A. K., Puljiz, D., Reynolds-Cuéllar, P., et al. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462060 · Cited by 54 · see citing works
Kuipers, B. (2018) · Communications of the ACM · doi:10.1145/3173087 · Cited by 54 · see citing works
Technology and moral change: the transformation of truth and trust
Danaher, J., & Sætra, H. S. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09661-y · Cited by 53 · see citing works
Not Only WEIRD but “Uncanny”? A Systematic Review of Diversity in Human–Robot Interaction Research
Seaborn, K., Barbareschi, G., & Chandra, S. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-00968-4 · Cited by 54 · see citing works
Modeling the Human-Robot Trust Phenomenon: A Conceptual Framework based on Risk
Wagner, A. R., Robinette, P., & Howard, A. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3152890 · Cited by 51 · see citing works
Self-citationArtificial agents’ explainability to support trust: considerations on timing and context
Papagni, G., de Pagter, J., Zafari, S., Filzmoser, M., & Koeszegi, S. T. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01462-7 · Cited by 52 · see citing works
Regulating for trust: Can law establish trust in artificial intelligence?
Tamò‐Larrieux, A., Guitton, C., Mayer, S., & Lutz, C. (2023) · Regulation & Governance · doi:10.1111/rego.12568 · Cited by 51 · see citing works
Zhou, L., Rudin, C. D., Gombolay, M., Spohrer, J., Professionals, I. S. O. S. I., Zhou, M. X., Juji, & Paul, S. (2023) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00185 · Cited by 49 · see citing works
Kim, T., & Song, H. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2049134 · Cited by 51 · see citing works
Self-Driving Cars: Ethical Responsibilities of Design Engineers
Borenstein, J., Herkert, J. R., & Miller, K. (2017) · IEEE Technology and Society Magazine · doi:10.1109/mts.2017.2696600 · Cited by 47 · see citing works
Trust Measurement in Human-Autonomy Teams: Development of a Conceptual Toolkit
Krausman, A., Neubauer, C. E., Forster, D. E., Lakhmani, S. G., Baker, A. L., Fitzhugh, S. M., Gremillion, G. M., Wright, J. L., Metcalfe, J. S., & Schaefer, K. E. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3530874 · Cited by 47 · see citing works
The Impact of First Impressions on Human- Robot Trust During Problem-Solving Scenarios
Xu, J. C., & Howard, A. M. (2018) · IEEE RO-MAN · doi:10.1109/roman.2018.8525669 · Cited by 46 · see citing works
Self-citationSocial Robotics and the Good Life
(2022) · transcript Verlag eBooks · doi:10.1515/9783839462652 · Cited by 44 · see citing works
Behavioural Responses to Robot Conversational Failures
Kontogiorgos, D., Pereira, A., Sahindal, B., van Waveren, S., & Gustafson, J. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3319502.3374782 · Cited by 44 · see citing works
DelPreto, J., Lipton, J., Sanneman, L. M., Fay, A. J., Fourie, C. K., Choi, C., & Rus, D. (2020) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra40945.2020.9196754 · Cited by 44 · see citing works
Teaching and AI in the postdigital age: Learning from teachers’ perspectives
Moylan, R., Code, J. R., & O'Brien, H. L. (2025) · Teaching and Teacher Education : An International Journal of Research and Studies · doi:10.1016/j.tate.2024.104851 · Cited by 44 · see citing works
Podpora, M., Gardecki, A., Beniak, R., Klin, B., Vicario, J. L., & Kawala‐Sterniuk, A. (2020) · Sensors · doi:10.3390/s20082376 · Cited by 43 · see citing works
Ethical and legal responsibility for Artificial Intelligence
Henz, P. (2021) · Discover Artificial Intelligence · doi:10.1007/s44163-021-00002-4 · Cited by 43 · see citing works
Zheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 41 · see citing works
Hasan, R., & Ojala, A. (2024) · Thunderbird International Business Review · doi:10.1002/tie.22369 · Cited by 41 · see citing works
Machine Learning Processes As Sources of Ambiguity: Insights from AI Art
Sivertsen, C., Salimbeni, G., Løvlie, A. S., Benford, S., & Zhu, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642855 · Cited by 41 · see citing works
Mixed Initiative Systems for Human-Swarm Interaction: Opportunities and Challenges
Hussein, A., & Abbass, H. A. (2018) · doi:10.1109/sysmc.2018.8509744 · Cited by 41 · see citing works
On the impact of different types of errors on trust in human-robot interaction
Flook, R., Shrinah, A., Wijnen, L., Eder, K., Melhuish, C., & Lemaignan, S. (2019) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.18067.flo · Cited by 41 · see citing works
Investigating Human Perceptions of Trust in Robots for Safe HRI in Home Environments
Rossi, A., Dautenhahn, K., Koay, K. L., & Saunders, J. (2017) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3029798.3034822 · Cited by 39 · see citing works
Trust Mediating Reliability–Reliance Relationship in Supervisory Control of Human–Swarm Interactions
Hussein, A., Elsawah, S., & Abbass, H. (2019) · Hum. Factors · doi:10.1177/0018720819879273 · Cited by 40 · see citing works
Understandable and trustworthy explainable robots: A sensemaking perspective
Papagni, G., & Koeszegi, S. T. (2020) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2021-0002 · Cited by 39 · see citing works
Zhang, Z., & Jia, L. (2020) · Applied Mathematical Modelling · doi:10.1016/j.apm.2020.08.075 · Cited by 38 · see citing works
Identifying psychological features of robots that encourage and discourage trust
Plaks, J. E., Rodriguez, L. B., & Ayad, R. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107301 · Cited by 38 · see citing works
Human-robot interaction: the impact of robotic aesthetics on anticipated human trust
Pinney, J., Carroll, F., & Newbury, P. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.837 · Cited by 35 · see citing works
Chang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 35 · see citing works
Shaikh, S. J., & Cruz, I. (2022) · AI & Society · doi:10.1007/s00146-021-01335-5 · Cited by 34 · see citing works
Conceptualizing Overtrust in Robots: Why Do People Trust a Robot That Previously Failed?
Robinette, P., Howard, A., & Wagner, A. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-59719-5_6 · Cited by 34 · see citing works
Self-citationWhy bad coffee? Explaining BDI agent behaviour with valuings
Winikoff, M., Sidorenko, G., Dignum, V., & Dignum, F. P. M. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103554 · Cited by 33 · see citing works
Trustworthy Embodied Conversational Agents for Healthcare
Lupetti, M. L., Hagens, E., van der Maden, W., Steegers‐Theunissen, R. P. M., & Rousian, M. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3597128 · Cited by 33 · see citing works
Challenges and Opportunities for Replication Science in HRI
Ullman, D. L., Aladia, S., & Malle, B. F. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434073.3444652 · Cited by 32 · see citing works
Ullman, D. L., & Malle, B. F. (2017) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3029798.3038423 · Cited by 32 · see citing works
Trust in Vocal Human–Robot Interaction: Implications for Robot Voice Design
Torre, I., & White, L. (2020) · Prosody, phonology and phonetics · doi:10.1007/978-981-15-6627-1_16 · Cited by 31 · see citing works
“I just shared your responses”
Sannon, S., Stoll, B., DiFranzo, D. J., Jung, M. F., & Bazarova, N. N. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3375188 · Cited by 31 · see citing works
Human Trust After Robot Mistakes: Study of the Effects of Different Forms of Robot Communication
Ye, S., Neville, G., Schrum, M., Gombolay, M., Chernova, S., & Howard, A. M. (2019) · IEEE RO-MAN · doi:10.1109/ro-man46459.2019.8956424 · Cited by 31 · see citing works
Self-citationRobot-Guided Evacuation as a Paradigm for Human-Robot Interaction Research
Wagner, A. R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.701938 · Cited by 32 · see citing works
Self-citationHiding Behind Machines: Artificial Agents May Help to Evade Punishment
Feier, T., Gogoll, J., & Uhl, M. (2022) · Science and Engineering Ethics · doi:10.1007/s11948-022-00372-7 · Cited by 31 · see citing works
Configuring Humans: What Roles Humans Play in HRI Research
Lee, H. R., Cheon, E., Lim, C., & Fischer, K. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889496 · Cited by 32 · see citing works
Deep learning, transparency, and trust in human robot teamwork
Lewis, M., Li, H., & Sycara, K. P. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819472-0.00014-9 · Cited by 29 · see citing works
- Authors
- Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 101-108
- OpenAlex
- W4254148040
- Cited by
- 468
- References
- 16
- Citations by year
- 2026: 33 · 2025: 59 · 2024: 68 · 2023: 52 · 2022: 71 · 2021: 53 · 2020: 46 · 2019: 38 · 2018: 27 · 2017: 17 · 2016: 4
- FWCI
- 48.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- Research Institute, Georgia Institute of Technology
- Georgia Institute of Technology
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Ocean Engineering › Evacuation and Crowd Dynamics
- Keywords
- trust in robots, emergency evacuation, human-robot interaction, guidance and navigation, emergency response
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
