Robot Capability and Intention in Trust-Based Decisions Across Tasks
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
In this paper, we present results from a human-subject study designed to explore two facets of human mental models of robots - inferred capability and intention - and their relationship to overall trust and eventual decisions. In particular, we examine delegation situations characterized by uncertainty, and explore how inferred capability and intention are applied across different tasks. We develop an online survey where human participants decide whether to delegate control to a simulated UAV agent. Our study shows that human estimations of robot capability and intent correlate strongly with overall self-reported trust. However, overall trust is not independently sufficient to determine whether a human will decide to trust (delegate) a given task to a robot. Instead, our study reveals that estimations of robot intention, capability, and overall trust are integrated when deciding to delegate. From a broader perspective, these results suggest that calibrating overall trust alone is insufficient; to make correct decisions, humans need (and use) multi-faceted mental models when collaborating with robots across multiple contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“An alternative riskrelated definition of trust is as the belief that a trustee will help the trustor’s goal in a situation characterized by uncertainty and trustor vulnerability [18], or just the willingness of the trustor to depend on another agent, even with the risk of possible negative consequences [19].”
BackgroundA Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 4×
“, [11], [25]) and subsequent decisionmaking [10], [14], [36].”
BackgroundInfluentialFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873 · cited 1×
“Muir’s seminal work on trust in automation [5], [6] and its effect on operator control allocation found that people’s reported subjective trust ratings were sensitive to the automation’s properties—the more reliable the automation, the higher the trust ratings, which subsequently led to increased automation reliance.”
BackgroundSimilarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577
Planning with Trust for Human-Robot Collaboration
Chen, M., Nikolaidis, S., Soh, H., Hsu, D., & Srinivasa, S. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171264 · Cited by 221
Self-citationEffect of Robot Performance on Human–Robot Trust in Time-Critical Situations
Robinette, P., Howard, A. M., & Wagner, A. R. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2648849 · Cited by 205
Establishing Appropriate Trust via Critical States
Huang, S. H., Bhatia, K., Abbeel, P., & Dragan, A. D. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593649 · Cited by 94
Research works printed but not linked: 27
- 10.3389/fpsyg.2016.00049 · DOI
- 10.1007/978-1-4899-7668-0_10 · DOI · Paper page
- hoffman, 2013, Evaluating Fluency in Human-Robot Collaboration, HRI Workshop on Human Robot Collaboration
- 10.5898/JHRI.4.3.Soh · DOI
- 10.1109/IROS.2013.6696815 · DOI
- 10.1177/0018720816634228 · DOI · Paper page
- castelfranchi, 2007, Trust Theory
- 10.5465/AMR.1995.9508080335 · doi:10.5465/amr.1995.9508080335 · Paper page
- gambetta, 2000, Can we trust trust, Trust Making and Breaking Cooperative Relations, 13, 213
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- 10.1016/j.dss.2005.05.019 · DOI · Paper page
- 10.1007/978-3-319-28872-7_7 · DOI
- 10.1177/0018720811417254 · DOI · Paper page
- desai, 2012, Modeling Trust to Improve Human-robot Interaction
- 10.1109/CTS.2007.4621745 · DOI · Paper page
- muir, 1989, Operators trust in and percentage of time spent using the automatic controllers in a supervisory process control task
- desai, 2012, Modeling Trust to Improve Human-robot Interaction
- xu, 2015, OPTIMo: Online Probabilistic Trust Inference Model for Asymmetric Human-Robot Collaborations, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI) HRI, 221
- 10.21236/ADA149621 · DOI · Paper page
- 10.15607/RSS.2018.XIV.033 · DOI
- groom, 2007, Can robots be teammates?: Benchmarks in humanrobot teams, Interaction Studies, 8, 483, 10.1075/is.8.3.10gro · DOI · Paper page
- 10.1111/1467-839X.00030 · DOI · Paper page
- 10.1109/IROS.2018.8593649 · DOI · Paper page
- shapiro, 2008, Achieving far transfer in an integrated cognitive architecture, AAAI, 1325
- carlson, 2011, Identifying Factors that Influence Trust in Automated Cars and Medical Diagnosis Systems, The Intersection of Robust Intelligence and Trust in Autonomous Systems Papers from the AAAI Spring Symposium, 20
- 10.1109/KBSE.1996.552822 · DOI
- 10.1109/HRI.2016.7451741 · DOI · Paper page
Cited by
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
Measurement of trust in automation: A narrative review and reference guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y.-C., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 315
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“Screening tasks [17, 33, 44, 63, 81, 82, 127, 130, 135, 139, 140], gathering of information [58], Military mission planning [92], human-AI collaboration for search and destroy missions [116]”
Background
Metadata
- Authors
- Xie, Y., Bodala, I. P., Ong, D. C., Hsu, D., & Soh, H.
- Venue
- 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2019-03
- Pages
- 39-47
- OpenAlex
- W2929617241
- Cited by
- 57
- References
- 10
- FWCI
- 9.73
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Robot Capability and Intention in Trust-Based Decisions Across Tasks. https://app.cochat.ai/papers/10.1109/hri.2019.8673084
- The paper
- Xie, Y., Bodala, I. P., Ong, D. C., Hsu, D., & Soh, H. (2019). Robot Capability and Intention in Trust-Based Decisions Across Tasks. 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). https://doi.org/10.1109/hri.2019.8673084
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.