Toward establishing trust in adaptive agents
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
As adaptive agents become more complex and take increasing autonomy in their user's lives, it becomes more important for users to trust and understand these agents. Little work has been done, however, to study what factors influence the level of trust users are willing to place in these agents. Without trust in the actions and results produced by these agents, their use and adoption as trusted assistants and partners will be severely limited. We present the results of a study among test users of CALO, one such complex adaptive agent system, to investigate themes surrounding trust and understandability. We identify and discuss eight major themes that significantly impact user trust in complex systems. We further provide guidelines for the design of trustable adaptive agents. Based on our analysis of these results, we conclude that the availability of explanation capabilities in these agents can address the majority of trust concerns identified by users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploring the design space for adaptive graphical user interfaces
Gajos, K. Z., Czerwinski, M., Tan, D. S., & Weld, D. S. (2006) · Proceedings of the working conference on Advanced visual interfaces - AVI '06 · doi:10.1145/1133265.1133306 · Cited by 198
Design and evaluation of an adaptive icon toolbar
Debevc, M., Meyer, B., Donlagic, D., & Svecko, R. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00126652 · Cited by 54 · cited 1×
“Other studies of mixed-initiative systems, such as [4, 10, 13] have looked specifically at the use of mixed-initiative adaptation for customizing GUI components, reporting on how the adaptation influences the performance time of various tasks and overall satisfaction with the interface.”
Background
Cited by
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
“Glass, McGuinness, and Wolverton (2008) interviewed users of an office assistant agent and found that correct expectations regarding the agent ’ s performance and capabilities facilitated trust in the agent.”
BackgroundQuestioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
“Also, to better understand factors that influence user trust in adaptive agents, Glass et al. [35] studied which types of questions users would like to be able to ask an adaptive assistant.”
BackgroundAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Metadata
- Authors
- Glass, A., McGuinness, D. L., & Wolverton, M.
- Venue
- Proceedings of the 13th international conference on Intelligent user interfaces
- Publisher
- ACM
- Published
- 2008-01-13
- Pages
- 227-236
- OpenAlex
- W2025544150
- Cited by
- 211
- References
- 2
- FWCI
- 7.94
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.