Impact of robot failures and feedback on real-time trust
The DOI matches its Crossref record; 19 of the 21 references it cites were found in a registry or an index.
Abstract
Prior work in human trust of autonomous robots suggests the timing of reliability drops impact trust and control allocation strategies. However, trust is traditionally measured post-run, thereby masking the real-time changes in trust, reducing sensitivity to factors like inertia, and subjecting the measure to biases like the primacy-recency effect. Likewise, little is known on how feedback of robot confidence interacts in real-time with trust and control allocation strategies. An experiment to examine these issues showed trust loss due to early reliability drops is masked in traditional post-run measures, trust demonstrates inertia, and feedback alters allocation strategies independent of trust. The implications of specific findings on development of trust models and robot design are also discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“however most studies used controlled user experiments (e.g., Spexard et al., 2008; Short et al., 2010; Desai et al., 2013; Salem et al., 2013, 2015; Gompei and Umemuro, 2015; Knepper et al., 2015; Hayes et al., 2016; Ragni et al., 2016; Robinette et al., 2016; Mirnig et al., 2017; Lucas et al., 2018).”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Desai et al., 2013
In the citing paper
“Failures reduce robots' perceived sincerity (Gompei and Umemuro, 2015), competence (Cha et al., 2015; Salem et al., 2015; Ragni et al., 2016), reliability (Salem et al., 2015; Ragni et al., 2016), understandability (Salem et al., 2015), trustworthiness (De Visser and Parasuraman, 2011; Desai et al., 2013; Salem et al., 2015; Law et al., 2017), intelligence (Takayama et al., 2011; Bajones et al., 2”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Desai et al., 2013
In the citing paper
“providing confidence feedback on the robot's performance encourages better control allocation without affecting user trust (Desai et al., 2013; Kaniarasu et al., 2013).”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Desai et al., 2013
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“Inappropriate control allocation strategies can result in over-reliance or under-reliance on the automated system [2].”
BackgroundA Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“For decades, researchers in the human-automation interaction .eld have investigated the control allocation strategies of operators under different circumstances (e.g., [6], [7], [8]) and observed how people use, misuse, or disuse automation (e.g., [2], [9], [10]).”
BackgroundTrust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 1×
“Similar attempts to understand how robot operators trust and utilize automated behaviors of robots have been made in the .eld of humanrobot interaction (HRI) (for a survey and analysis of recent research see [19]).”
BackgroundTrust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386
Dixon, S. R., & Wickens, C. D. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006778606822 · Cited by 280 · cited 1×
“IN T RO D U C T I O N During an operator s interaction with an autonomous system, a key issue is how the operator uses the available autonomy levels, often referred to as the control allocation strategy [1].”
MethodBahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279 · cited 1×
“Inappropriate control allocation strategies can result in over-reliance or under-reliance on the automated system [2].”
Backgroundde Vries, P., Midden, C., & Bouwhuis, D. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00039-9 · Cited by 264 · cited 4×
“…on Real-Time Trust Munjal Desai1, Poornima Kaniarasu2, Mikhail Medvedev1, Aaron Steinfeld2, and Holly Yanco1 1University of Massachusetts Lowell email: {mdesai, mmedvede, holly}@cs.uml.edu Abstract Prior work in human trust of autonomous robots suggests the timing of reliability drops…”
BackgroundMethodInfluential
Research works printed but not linked: 4
- wickens, 2002, Automation Trust Reliability and Attention HMI 02-03
- wickens, 2003, How Does Automation Reliability Influence Workload 1st Annual Robotics Consortium
- lee, 1992, Trust Self-confidence and Operator's Adaptation to Automation
- muir, 1983, Operators' trust in and use of automatic controllers in a supervisory process control task
Cited by
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Toward a Framework for Levels of Robot Autonomy in Human-Robot Interaction
Beer, J. M., Fisk, A. D., & Rogers, W. A. (2014) · Journal of Human-Robot Interaction · doi:10.5898/jhri.3.2.beer · Cited by 629
Overtrust of robots in emergency evacuation scenarios
Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451740 · Cited by 468
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
“Trust measurement remains a key issue for HRT interaction [34,35,44,53].”
BackgroundHonig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338
“…(e.g., Gieselmann, 2006; Gehle et al., 2015), however most studies used controlled user experiments (e.g., Spexard et al., 2008; Short et al., 2010; Desai et al., 2013; Salem et al., 2013, 2015; Gompei and Umemuro, 2015; Knepper et al., 2015; Hayes et al., 2016; Ragni et al., 2016; Robinette et…”
BackgroundInfluential
Metadata
- Authors
- Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H.
- Affiliations
- University of Massachusetts Lowell (US)
- Carnegie Mellon University (US)
- Venue
- 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2013-03
- Pages
- 251-258
- OpenAlex
- W4231751901
- Semantic Scholar
- ae60863ca2de576f7f9343d6c8f86ed258aa9741
- Cited by
- 234
- References
- 21
- Citations by year
- 2026: 12 · 2025: 29 · 2024: 41 · 2023: 38 · 2022: 11 · 2021: 28 · 2020: 21 · 2019: 13 · 2018: 12 · 2017: 9 · 2016: 10 · 2015: 6 · 2014: 4
- FWCI
- 13.40
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- National Science Foundation
- Carnegie Mellon University
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- autonomous robots, robot failure, trust model, robot design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of robot failures and feedback on real-time trust. https://app.cochat.ai/papers/10.1109/hri.2013.6483596
- The paper
- Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H. (2013). Impact of robot failures and feedback on real-time trust. 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI). https://doi.org/10.1109/hri.2013.6483596
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.