Impact of robot failures and feedback on real-time trust
The DOI matches its OpenAlex record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Abstract—Prior work in human trust of autonomous robots suggests the timing of reliability drops impact trust and control allocation strategies. However, trust is traditionally measured post-run, thereby masking the real-time changes in trust, reduc-ing sensitivity to factors like inertia, and subjecting the measure to biases like the primacy-recency effect. Likewise, little is known on how feedback of robot confidence interacts in real-time with trust and control allocation strategies. An experiment to examine these issues showed trust loss due to early reliability drops is masked in traditional post-run measures, trust demonstrates inertia, and feedback alters allocation strategies independent of trust. The implications of specific findings on development of trust models and robot design are also discussed. I.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386
Bahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279
de Vries, P., Midden, C., & Bouwhuis, D. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00039-9 · Cited by 264
Effects of changing reliability on trust of robot systems
Desai, M., Medvedev, M., Vázquez, M., McSheehy, S., Gadea-Omelchenko, S., Bruggeman, C., Steinfeld, A., & Yanco, H. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157702 · Cited by 188
Self-citation
Cited by
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Toward a Framework for Levels of Robot Autonomy in Human-Robot Interaction
Beer, J. M., Fisk, A. D., & Rogers, W. A. (2014) · Journal of Human-Robot Interaction · doi:10.5898/jhri.3.2.beer · Cited by 629
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
The Role of Trust in Human-Robot Interaction
Lewis, M., Sycara, K., & Walker, P. (2018) · Studies in Systems, Decision and Control · doi:10.1007/978-3-319-64816-3_8 · Cited by 281
Simões, A. C., Pinto, A., Santos, J., Pinheiro, S., & Romero, D. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.11.007 · Cited by 233
Evolving Trust in Robots: Specification Through Sequential and Comparative Meta-Analyses
Hancock, P. A., Kessler, T. T., Kaplan, A. D., Brill, J. C., & Szalma, J. L. (2021) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820922080 · Cited by 229
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Effects of Anthropomorphism and Accountability on Trust in Human Robot Interaction
Natarajan, M., & Gombolay, M. (2020) · Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3319502.3374839 · Cited by 248
Planning with Trust for Human-Robot Collaboration
Chen, M., Nikolaidis, S., Soh, H., Hsu, D., & Srinivasa, S. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171264 · Cited by 221
Automated rationale generation: a technique for explainable AI and its effects on human perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. O. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302316 · Cited by 210
Evaluating Effects of User Experience and System Transparency on Trust in Automation
Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020230 · Cited by 208
Trust in socially assistive robots: Considerations for use in rehabilitation
Langer, A., Feingold-Polak, R., Mueller, O., Kellmeyer, P., & Levy-Tzedek, S. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.014 · Cited by 178
Modeling and predicting trust dynamics in human–robot teaming: A Bayesian inference approach
Guo, Y., & Yang, X. J. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00703-3 · Cited by 133
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
Kwon, M., Huang, S. H., & Dragan, A. D. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171276 · Cited by 123
Nourani, M., King, J., & Ragan, E. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7469 · Cited by 116
“I Don't Believe You”: Investigating the Effects of Robot Trust Violation and Repair
Sebo, S. S., Krishnamurthi, P., & Scassellati, B. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673169 · Cited by 110
Human–robot similarity and willingness to work with a robotic co-worker
You, S., & Robert Jr., L. P. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171281 · Cited by 118
Taxonomy of Trust-Relevant Failures and Mitigation Strategies
Tolmeijer, S., Weiss, A., Hanheide, M., Lindner, F., Powers, T. M., Dixon, C., & Tielman, M. L. (2020) · Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3319502.3374793 · Cited by 103
Robots for Joy, Robots for Sorrow: Community Based Robot Design for Dementia Caregivers
Moharana, S., Panduro, A. E., Lee, H. R., & Riek, L. D. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673206 · Cited by 104
Second Chance for a First Impression? Trust Development in Intelligent System Interaction
Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., & Bernstein, A. (2021) · Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3450613.3456817 · Cited by 67
Cha, E., Dragan, A. D., & Srinivasa, S. S. (2015) · 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2015.7333656 · Cited by 63
Getting to Know Each Other: The Role of Social Dialogue in Recovery from Errors in Social Robots
Lucas, G. M., Boberg, J., Traum, D., Artstein, R., Gratch, J., Gainer, A., Johnson, E., Leuski, A., & Nakano, M. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171258 · Cited by 61
Effects of blame on trust in human robot interaction
Kaniarasu, P., & Steinfeld, A. M. (2014) · The 23rd IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2014.6926359 · Cited by 59
Self-citationChen, J., Mishler, S., Hu, B., Li, N., & Proctor, R. W. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.05.010 · Cited by 50
Modeling the Human-Robot Trust Phenomenon: A Conceptual Framework based on Risk
Wagner, A. R., Robinette, P., & Howard, A. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3152890 · Cited by 51
Analysis of reactions towards failures and recovery strategies for autonomous robots
Brooks, D. J., Begum, M., & Yanco, H. A. (2016) · 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2016.7745162 · Cited by 46
Self-citationChen, J., Mishler, S., & Hu, B. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3051137 · Cited by 40
Bajones, M., Weiss, A., & Vincze, M. (2016) · arXiv · doi:10.48550/arxiv.1606.02547 · Cited by 20
Communicating Missing Causal Information to Explain a Robot’s Past Behavior
Han, Z., & Yanco, H. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3568024 · Cited by 11
Self-citation
Metadata
- Authors
- Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A. M., & Yanco, H. A.
- Published
- 2013-03-03
- Pages
- 251-258
- DOI
- 10.5555/2447556.2447663
- OpenAlex
- W2038041609
- Cited by
- 139
- References
- 11
- FWCI
- 12.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.