The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Will You Accept an Imperfect AI?: Exploring Designs for Adjusting End-user Expectations of AI Systems
Abstract
AI technologies have been incorporated into many end-user applications. However, expectations of the capabilities of such systems vary among people. Furthermore, bloated expectations have been identified as negatively affecting perception and acceptance of such systems. Although the intelligibility of ML algorithms has been well studied, there has been little work on methods for setting appropriate expectations before the initial use of an AI-based system. In this work, we use a Scheduling Assistant - an AI system for automated meeting request detection in free-text email - to study the impact of several methods of expectation setting. We explore two versions of this system with the same 50% level of accuracy of the AI component but each designed with a different focus on the types of errors to avoid (avoiding False Positives vs. False Negatives). We show that such different focus can lead to vastly different subjective perceptions of accuracy and acceptance. Further, we design expectation adjustment techniques that prepare users for AI imperfections and result in a significant increase in acceptance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the success of many productive ML applications in real-world settings falls short of expectations [4].”
From Machine Learning Operations (MLOps): Overview, Definition, and Architecture (2023) · cites this paper as [4]
In the citing paper
“Kocielnik et al. [29] found that AI systems that showcase subsets of errors, like false positives or false negatives, that have the same accuracy, can lead to vastly different perceptions of accuracy.”
From Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences (2024) · cites this paper as [29]
In the citing paper
“People also expect AIs to be more competent and to act less immorally than humans [1,31,50,59], which could make the negative action more surprising.”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [31]
In the citing paper
“Accurately priming the user and adjusting their expectations to the system is difficult, and simply providing performance metrics is not meaningful to the average user, given their lack of familiarity with the inner workings of the technologies that they interact with [26, 30].”
From From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust? (2024) · cites this paper as [30]
Citations
Cites
(1975) · PhilPapers (PhilPapers Foundation) · Cited by 36,737
A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies
Venkatesh, V., & Davis, F. D. (2000) · Management Science · doi:10.1287/mnsc.46.2.186.11926 · Cited by 23,066
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767 · cited 4×
“A number of theories related to expectations have been proposed [6, 37, 39].”
BackgroundMethodInfluentialAn Investigation into the Determinants of Customer Satisfaction
Churchill, G. A., & Surprenant, C. (1982) · Journal of Marketing Research · doi:10.2307/3151722 · Cited by 2,914
Oliver, R. L. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.4.480 · Cited by 1,770
A Survey of Context-Aware Mobile Computing Research
Chen, G., & Kotz, D. F. (2000) · Cited by 1,749
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
An Experimental Study of Customer Effort, Expectation, and Satisfaction
Cardozo, R. N. (1965) · Journal of Marketing Research · doi:10.1177/002224376500200303 · Cited by 1,178
Research works printed but not linked: 7
- T Bentley. 2000. Biasing Web Site User Evaluations: a study. In Proceedings of the Conference of the Computer Human Interaction Special Interest Group of the Ergonomics Society of Australia (OzCHI2000). 130-- 134.
- 10.5555/2906831.2906851 · doi:10.5555/2906831.2906851
- Patrice Simard, David Chickering, Aparna Lakshmiratan, Denis Charles, Léon Bottou, Carlos Garcia Jurado Suarez, David Grangier, Saleema Amershi, Johan Verwey, and Jina Suh. 2014. ICE: enabling nonexperts to build models interactively for large-scale lopsided problems. arXiv preprint arXiv:1409.4814 (2014). · arXiv
- S Stumpf, A Bussone, and D O'Sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI).
- 10.5555/2786232.2786234 · doi:10.5555/2786232.2786234
- 10.5555/2017458.2017463 · doi:10.5555/2017458.2017463
- Daniel S Weld and Gagan Bansal. 2018. Intelligible Artificial Intelligence. arXiv preprint arXiv:1803.04263 (2018). · arXiv
Cited by
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
Machine Learning Operations (MLOps): Overview, Definition, and Architecture
Kreuzberger, D., Kühl, N., & Hirschl, S. (2023) · IEEE Access · doi:10.1109/access.2023.3262138 · Cited by 766
“However, the success of many productive ML applications in real-world settings falls short of expectations [21].”
Background
Metadata
- Authors
- Kocielnik, R., Amershi, S., & Bennett, P. N.
- Affiliations
- University of Washington, Seattle, WA, USA
- Microsoft (United States) (US)
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-14
- OpenAlex
- W2918497321
- Cited by
- 277
- References
- 49
- Citations by year
- 2026: 49 · 2025: 48 · 2024: 46 · 2023: 37 · 2022: 29 · 2021: 42 · 2020: 22 · 2019: 3
- FWCI
- 19.43
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- AI acceptance, expectation setting, false positives, false-negative results, perceived accuracy, user perceptions of AI, explainable AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Will You Accept an Imperfect AI?: Exploring Designs for Adjusting End-user Expectations of AI Systems. https://app.cochat.ai/papers/10.1145/3290605.3300641
- The paper
- Kocielnik, R., Amershi, S., & Bennett, P. N. (2019). Will You Accept an Imperfect AI?: Exploring Designs for Adjusting End-user Expectations of AI Systems. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300641
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.