The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
I can do better than your AI: expertise and explanations
Abstract
Intelligent assistants, such as navigation, recommender, and expert systems, are most helpful in situations where users lack domain knowledge. Despite this, recent research in cognitive psychology has revealed that lower-skilled individuals may maintain a sense of illusory superiority, which might suggest that users with the highest need for advice may be the least likely to defer judgment. Explanation interfaces - a method for persuading users to take a system's advice - are thought by many to be the solution for instilling trust, but do their effects hold for self-assured users? To address this knowledge gap, we conducted a quantitative study (N=529) wherein participants played a binary decision-making game with help from an intelligent assistant. Participants were profiled in terms of both actual (measured) expertise and reported familiarity with the task concept. The presence of explanations, level of automation, and number of errors made by the intelligent assistant were manipulated while observing changes in user acceptance of advice. An analysis of cognitive metrics lead to three findings for research in intelligent assistants: 1) higher reported familiarity with the task simultaneously predicted more reported trust but less adherence, 2) explanations only swayed people who reported very low task familiarity, and 3) showing explanations to people who reported more task familiarity led to automation bias.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“several studies suggest that overloading users with information about the system could potentially harm people's situation awareness and lead to worse performance or decision-making outcome [6, 27, 29].”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [29]
In the citing paper
“Prior work suggests that subjective self-reported trust may not be a reliable indicator for trusting behaviors [16, 29], which are what ultimately matter in AI-assisted decision tasks.”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [29]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Axelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Making sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731
The structure of phenotypic personality traits.
Goldberg, L. R. (1993) · American Psychologist · doi:10.1037/0003-066x.48.1.26 · Cited by 4,816
Lord, C. G., Ross, L., & Lepper, M. R. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.11.2098 · Cited by 4,583
(2011) · Springer eBooks · doi:10.1007/978-0-387-85820-3 · Cited by 3,761
Eppler, M. J., & Mengis, J. (2008) · Kommunikationsmanagement im Wandel · doi:10.1007/978-3-8349-9772-2_15 · Cited by 2,177
Situation Awareness Analysis and Measurement
(2000) · CRC Press eBooks · doi:10.1201/b12461 · Cited by 2,046
Research works printed but not linked: 5
- Robyn M Dawes and Richard H Thaler . 1988. Anomalies: cooperation. The Journal of Economic Perspectives ( 1988 ), 187--197. Robyn M Dawes and Richard H Thaler. 1988. Anomalies: cooperation. The Journal of Economic Perspectives (1988), 187--197.
- Mica R Endsley and Daniel J Garland . 2000. Situation awareness analysis and measurement . CRC Press . Mica R Endsley and Daniel J Garland. 2000. Situation awareness analysis and measurement. CRC Press.
- C Gonzalez , N Ben-Asher , JM Martin , and V Dutt . 2013. Emergence of cooperation with increased information: Explaining the process with instance-based learning models. Unpublished manuscript under review ( 2013 ). C Gonzalez, N Ben-Asher, JM Martin, and V Dutt. 2013. Emergence of cooperation with increased information: Explaining the process with instance-based learning models. Unpublished manuscript under review (2013).
- Sherrie YX Komiak and Izak Benbasat . 2006. The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS quarterly ( 2006 ), 941--960. Sherrie YX Komiak and Izak Benbasat. 2006. The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS quarterly (2006), 941--960.
- 10.1037/0022-3514.77.2.221 · doi:10.1037/0022-3514.77.2.221 · Paper page
Cited by
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Three Challenges for AI-Assisted Decision-Making
Steyvers, M., & Kumar, A. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231181102 · Cited by 217
Wysocki, O., Davies, J. K., Vigo, M., Armstrong, A. C., Landers, D., Lee, R., & Freitas, A. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2022.103839 · Cited by 161
“In [13] explanations only had an impact on HCPs who felt they had insufficient knowledge to achieve their given task, which may signify that the knowledge gap was addressed by the model’s output.”
Metadata
- Authors
- Schaffer, J., O'Donovan, J., Michaelis, J., Raglin, A., & Höllerer, T.
- Affiliations
- DEVCOM Army Research Laboratory (US)
- University of California Santa Barbara
- University of California, Santa Barbara (US)
- Venue
- Proceedings of the 24th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2019-03-17
- Pages
- 240-251
- OpenAlex
- W2915124689
- Cited by
- 119
- References
- 58
- Citations by year
- 2026: 22 · 2025: 16 · 2024: 20 · 2023: 23 · 2022: 15 · 2021: 12 · 2020: 9 · 2019: 2
- FWCI
- 15.69
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- intelligent assistants, automation bias, trust in AI, task familiarity, advice acceptance, binary decision making, AI errors, levels of automation, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: I can do better than your AI: expertise and explanations. https://app.cochat.ai/papers/10.1145/3301275.3302308
- The paper
- Schaffer, J., O'Donovan, J., Michaelis, J., Raglin, A., & Höllerer, T. (2019). I can do better than your AI: expertise and explanations. Proceedings of the 24th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3301275.3302308
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.