The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Overtrust of robots in emergency evacuation scenarios
Abstract
Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Poor trust calibration sometimes causes serious safety issues [3, 4].”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [4]
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“Hancock et al. performed a meta-analysis over the existing human-robot trust literature identifying 11 relevant research articles and found that, for these papers, robot performance is most strongly associated with trust [7].”
BackgroundSalem, M., Lakatos, G., Amirabdollahian, F., & Dautenhahn, K. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696497 · Cited by 494
The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents
Bainbridge, W. A., Hart, J., Kim, E. S., & Scassellati, B. M. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0082-7 · Cited by 478
Trust and etiquette in high-criticality automated systems
Parasuraman, R., & Miller, C. A. (2004) · Communications of the ACM · doi:10.1145/975817.975844 · Cited by 311
Impact of robot failures and feedback on real-time trust
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H. (2013) · 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483596 · Cited by 234
Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations
Robinette, P., Howard, A. M., & Wagner, A. R. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2648849 · Cited by 205
Self-citationReport of the technical investigation of The Station nightclub fire
Grosshandler, W. L., Bryner, N. P., Madrzykowski, D. M., & Kuntz, K. (2005) · doi:10.6028/nist.ncstar.2v1 · Cited by 148
Timing Is Key for Robot Trust Repair
Robinette, P., Howard, A. M., & Wagner, A. R. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-25554-5_57 · Cited by 121
Self-citationHuman behaviour in fire: the development and maturity of a scholarly study area
Bryan, J. L. (1999) · Fire and Materials · doi:10.1002/(sici)1099-1018(199911/12)23:6 · Cited by 60
Flagged first, then by citations
Research works printed but not linked: 2
- safarik, 2014, An all-time record 97 buildings of 200 meters or higher completed in 2014, CTBUH Year in Review
- 10.1518/hfes.46.1.50.30392 · DOI · Paper page
Cited by
Sorted by citations
Items 401–467 of 467
Perceiving a humorous robot as a social partner
Green, H. N., Islam, M. M., Ali, S., & Iqbal, T. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15988-6.00012-1
Toward a causal modeling approach for trust-based interventions in human-autonomy teams
Baker, A. L., Forster, D. E., Reichenberg, R. E., Neubauer, C. E., Fitzhugh, S. M., & Krausman, A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15988-6.00011-x
Investigating Robot Influence on Human Behaviour By Leveraging Entrainment Effects
Zhu, L., & Moon, A. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610978.3638367
Characterizing Evacuee Behavior During a Robot-Guided Evacuation
Nayyar, M., Paik, G., Yuan, Z., Zheng, T., Zhu, M., Lin, H., & Wagner, A. R. (2023) · IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) · doi:10.1109/ssrr59696.2023.10499953
Self-citationEnhancing Emergency Response: The Leg-Pulling Robot for Efficient Evacuations
Kafková, J., Gažovič, P., Šimák, V., Kuchár, P., Pirník, R., & Girolamo, S. D. (2024) · ELEKTRO · doi:10.1109/elektro60337.2024.10556888
Interaction of Humans and Autonomous Robots
Dobeš, M. (2024) · Acta Avionica · doi:10.35116/aa.2024.0009
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.002.0008
Taking a Moral Gambit: Accepting Moral Responsibility for the Actions of Autonomous Weapons Systems
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0007
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.002.0007
Adversarial and Non-kinetic Uses of AI: Conceptual and Ethical Challenges
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0004
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.002.0003
Adversarial and Kinetic Uses of AI: The Definition of Autonomous Weapon Systems
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0006 · Cited by 1
Adversarial and Non-kinetic Uses: The Case of Artificial Intelligence for Cyber Deterrence
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0005
Sustainment and Support Uses of AI in Defence: The Case of AI-Augmented Intelligence Analysis
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0003
Ethical Principles for AI in Defence
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.003.0002
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.002.0005
Stull, M. P., Lohrmann, C., & Hayes, B. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731361
Overtrusting a Simple Non-humanoid Robot in a Training Process
Erel, H., Koren, M., Grishko, A., Megidish, B., & Yaar, N. M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-3519-1_32
Retracted: Feedback Control Based on Trust for Varied Automation Transparency
Dbritto, C., Lopes, J., Bandyopadhyay, K., Banerji, N., Mishra, I., & Kandpal, A. (2025) · International Conference on Advances in Computer Science, Electrical, Electronics, and Communication Technologies (CE2CT) · doi:10.1109/ce2ct64011.2025.10939546
RetractedEvacuee Behavior Modeling during Robot-Guided Evacuations
Nayyar, M., & Wagner, A. R. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01259-w
Self-citationValidation and Evacuee Modeling of Virtual Robot-guided Emergency Evacuation ExperimentsPreprint
Yin, Y., Nayyar, M., Holman, D., Lucas, G., Holbrook, C., & Wagner, A. R. (2025) · doi:10.31234/osf.io/mr78s_v2
Self-citationDecolonizing the Curriculum in the Age of Digital Structural Violence
Harrison, L. M., Bah, S., & Carver, J. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-2955-0.ch018
Taking a leap of faith: insights from UK first responders on instantaneous trust
Nichele, E., Weerawardhana, S., & Lu, Y. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05016-2
The Role of Trust in Human-Robot Interaction: A Perspective on Factors Influencing Trust Development
Adeniyi, D. (2025) · International Research Journal of Innovations in Engineering and Technology · doi:10.47001/irjiet/2025.906013
Vinanzi, S. (2025) · doi:10.1093/9780198952930.003.0002
Vinanzi, S. (2025) · doi:10.1093/9780198952930.002.0005
Vinanzi, S. (2025) · doi:10.1093/9780198952930.003.0003
Vinanzi, S. (2025) · doi:10.1093/9780198952930.002.0004
Vinanzi, S. (2025) · doi:10.1093/9780198952930.003.0001
Vinanzi, S. (2025) · doi:10.1093/9780198952930.003.0004
The Role of Drone Appearance and Capability in Human Trust: A Comparative vs. Isolated Analysis
Khavas, Z. R., Majdi, A., Azadeh, S. R., & Robinette, P. (2025) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur65550.2025.11078060
Self-citationHow Sound-Based Robot Communication Impacts Perceptions of Robotic Failure
Crider, J. L., Preston, R. C., & Fitter, N. T. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127738
Sequential Game Model for Urban Emergency Human–Machine Collaborative Decision-Making
Shan, S., Zhang, Y., Hao, J., Zhang, F., & Han, G. (2025) · Applied Sciences · doi:10.3390/app151810083
Faulty Trust: A Pilot Study on Trust in the Social Robot Navel in a Collaborative Task
Mandl, S., Vitt, V., & Strobel, A. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-05681-8_18
The effects of robot learning on human teachers for learning from demonstration
Hedlund-Botti, E., Schalkwyk, J., Johnson, M., & Gombolay, M. (2025) · Autonomous Robots · doi:10.1007/s10514-025-10216-5
A JTB based study of epistemic attribution to robots as “Knowledge”
Matsui, T. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00534-z
Bharat, K., Srivastava, S., Garg, A., Sharma, R. B., & Tripathi, S. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83708-250-620251009
Effects of Perceived Robot Autonomy and Personal Differences on Trust in Human-Robot Interactions
Fallahi, A., Holthaus, P., Amirabdollahian, F., & Lakatos, G. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2382-5_32
When Robots Say No: Temporal Trust Recovery Through Explanation
Webb, N., Huang, Z., Milivojević, S., Baber, C., & Hunt, E. R. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2379-5_29
Educational ideals affect AI acceptance in learning environments
Richter, F., & Uhl, M. (2026) · AI and Ethics · doi:10.1007/s43681-025-00979-z
Cognitive assistance in extreme environments: A qualitative lens on human-robot teaming
Balasuriya, S. S., Edgar, G., & Sitbon, L. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29266-8.00004-9
Zhong, M., Miranda, L., Papadopoulos, F. C., Winkle, K., Skalkidou, A., & Castellano, G. (2026) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3797257
Plausible Explanations Reduce Phantom Cost Perception in HRI
Lebrun, B., Bartneck, C., & Vonasch, A. J. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3788804
When Robots Say No: The Empathic Ethical Disobedience Benchmark
Kuzmenko, D., & Shvai, N. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3785547
Williams, T., & Bejarano, A. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3788666
Jia, L., Ye, Y., Styler, B. K., & Du, N. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3788662
Xinshen and the ethics of belief in human-AI relations: a Mozi-inspired ethical reinterpretation
Pang, W. Y. (2026) · Synthese · doi:10.1007/s11229-025-05370-3
FARIA, E. G., Pinto, A., Oliveira, S. A. D. S., Assunção, G., & Menezes, P. J. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2643350
Measuring human likeness of artificial intelligence to natural intelligence
Xia, Y., Zhu, B., Geng, M., Zhu, S., Sun, S., Chen, H., Chen, X. M., Na, X., Ye, J., & Tang, C. S. (2026) · The Innovation Informatics · doi:10.59717/j.xinn-inform.2026.100047
The Role of Trust in the Educational Integration of Social Robots and Artificial Intelligence
Cirasa, C., Høgsdal, H., & Conti, D. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6471-1.ch015
Hu, Y., Indurkhya, B., & Fujinami, K. (2026) · Applied Sciences · doi:10.3390/app16136396
Chen, L., & Chen, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30414-8_1
Keeping Humans in the Driver’s Seat: A Conceptual Framework for GenAI and Competence Debt
Lüders, C. M., Krużycki, O., & Brandt, C. (2026) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3803437.3806707
Reyes-Cruz, G., Romeo, M., Price, D., Aylett, M. P., Greenhalgh, C., & Fischer, J. E. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816228
TRACE: Trustworthy Reasoning for Agentic Chemical Evidence in Antibody-Drug Conjugate Design
Amjad, M., Khan, M. U. S., & Khan, S. U. (2026) · IEEE Access · doi:10.1109/access.2026.3720203
Tang, Y., Zhou, P., Zhang, Y., Chen, W., Wu, W., & Liu, S. (2026) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste69562.2026.11649624
Trust dimensions and operational performance in VR-based drone tasks in construction
Hussain, R., Nnaji, C. A., & Onnesha, U. S. (2026) · Engineering Construction & Architectural Management · doi:10.1108/ecam-02-2026-0211
User-Friendly AI-Based Decision Support Systems
Echeverry, N. (2026) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw71585.2026.11712078
Why overtrust in social robots is inevitable
Fischer, K. (2026) · Pragmatics and Society · doi:10.1075/ps.25209.fis
Rabe, J., Sciutti, A., Zonca, J., Pasquali, D., & Rea, F. (2026) · Springer tracts in advanced robotics · doi:10.1007/978-3-032-19374-2_22
Touch Boundaries During Physical Human-Robot Interaction
Pan, G., Kaur, G., & Alves‐Oliveira, P. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714816
Organizational Ergonomics in Robotics
Kant, V., Rea, F., & Bracco, F. (2026) · Springer tracts in advanced robotics · doi:10.1007/978-3-032-19374-2_4
Zhang, T., Song, L., Zhao, Y., & Wang, Y. (2026) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3860538
Performance and moral trust in care robotics: ethical foundations for human–robot relationships
Yasuda, A., & Maruyama, Y. (2026) · AI and Ethics · doi:10.1007/s43681-026-01459-8
Metadata
- Authors
- Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 101-108
- OpenAlex
- W4254148040
- Cited by
- 468
- References
- 16
- Citations by year
- 2026: 33 · 2025: 59 · 2024: 68 · 2023: 52 · 2022: 71 · 2021: 53 · 2020: 46 · 2019: 38 · 2018: 27 · 2017: 17 · 2016: 4
- FWCI
- 48.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- Research Institute, Georgia Institute of Technology
- Georgia Institute of Technology
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Safety Research › Evacuation and Crowd Dynamics
- Keywords
- trust in robots, emergency evacuation, human-robot interaction, guidance and navigation, emergency response
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
