The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
Open accessAbstract
Artificial Intelligence (AI) plays an increasingly important role in improving HCI and user experience. Yet many challenges persist in designing and innovating valuable human-AI interactions. For example, AI systems can make unpredictable errors, and these errors damage UX and even lead to undesired societal impact. However, HCI routinely grapples with complex technologies and mitigates their unintended consequences. What makes AI different? What makes human-AI interaction appear particularly difficult to design? This paper investigates these questions. We synthesize prior research, our own design and research experience, and our observations when teaching human-AI interaction. We identify two sources of AI's distinctive design challenges: 1) uncertainty surrounding AI's capabilities, 2) AI's output complexity, spanning from simple to adaptive complex. We identify four levels of AI systems. On each level, designers encounter a different subset of the design challenges. We demonstrate how these findings reveal new insights for designers, researchers, and design tool makers in productively addressing the challenges of human-AI interaction going forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Harnessing LMs' generative capabilities to power interaction designs begins with a holistic understanding of these capabilities [5,68]; this includes understanding what LMs can and cannot do under diverse interaction contexts.”
From CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities (2022) · cites this paper as [68]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Due to the unique characteristics of AI systems (e.g., unpredictability and inconsistency), they are restricted to adapting and applying traditional user experience design principles to AI-powered systems [29].”
From Design implications of generative AI systems for visual storytelling for young learners (2023) · cites this paper as [29]
Experimental — accuracy not yet measuredIn the citing paper
“These challenges include AI's ability to understand complex language, grasp contextual nuances, and provide transparent explanations for its decisions [109], [110].”
From Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond (2024) · cites this paper as [110]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2011) · Cited by 3,330
Kaplan, A., & Haenlein, M. (2019) · Business Horizons · doi:10.1016/j.bushor.2018.08.004 · Cited by 3,140 · cited 1×
“The definitions of AI generally fall into two camps [27, 32, 50].”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Prior research has been addressing these challenges by promoting interaction design guidelines [4, 35].”
MethodGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 4×
“Prior research has been addressing these challenges by promoting interaction design guidelines [4, 35].”
BackgroundMethodInfluentialResearch through design as a method for interaction design research in HCI
Zimmerman, J., Forlizzi, J., & Evenson, S. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240704 · Cited by 2,304
Self-citationGodel, Escher, Bach: An Eternal Golden Braid.
Lieberson, J., & Hofstadter, D. R. (1980) · The Journal of Philosophy · doi:10.2307/2025598 · Cited by 1,914
Gaver, W. W. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108856 · Cited by 1,536 · cited 1×
“Designers need to understand the capabilities and limitations of a technology in order to know the possibilities it offers for design [17].”
BackgroundWizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines
Riek, L. (2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri.1.1.riek · Cited by 779
Implicit human computer interaction through context
Schmidt, A. (2000) · Personal Technologies · doi:10.1007/bf01324126 · Cited by 637 · cited 1×
“Research has chosen a number of different frames for investigating these challenges including human-AI interaction . design, AI/machine learning as a design material, the design of intelligent systems, designing for/with data [6, 14, 37], and many more [33, 42, 43].”
BackgroundWhy and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“design, AI/machine learning as a design material, the design of intelligent systems, designing for/with data [6, 14, 37], and many more [33, 42, 43].”
Background
Research works printed but not linked: 9
- 2017. Designing the User Experience of Machine Learning Systems Papers from the 2017 AAAI Spring Symposium Technical Report SS-17-04 Palo Alto California USA March 27--29 2017. AAAI. https://mikek-parc.github.io/AAAI-UX-ML/
- 2018. The Design of the User Experience for Artificial Intelligence (The UX of AI), Papers from the 2018 AAAI Spring Symposium, Palo Alto, California, USA, March 26--28, 2018. AAAI. https://mikek-parc.github.io/AAAI-UX-AI/
- Amber Cartwright. 2016. Invisible Design: Co-Designing with Machines. http://airbnb.design/invisible-design/
- Design Council. 2005. The 'double diamond' design process model. Design Council (2005).
- Patrick Hebron. 2016. Machine learning for designers. O'Reilly Media.
- 10.1145/354401.354406 · DOI · Paper page
- Kayur Dushyant Patel. 2012. Lowering the Barrier to Applying Machine Learning. Ph.D. Dissertation. University of Washington.
- Qian Yang, Nikola Banovic, and John Zimmerman. 2018. Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '18 (CHI '18). ACM.
- 10.1145/3196709.3196730 · DOI · Paper page
Cited by
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
“However, in other application domains, it will be important to follow best practices in human-AI design [5, 107] to understand errors and how they might percolate into the user experience.”
BackgroundDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635
Design Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501825 · Cited by 639
Six Human-Centered Artificial Intelligence Grand Challenges
Ozmen Garibay, O., Winslow, B., Andolina, S., Antona, M., Bodenschatz, A., Coursaris, C., Falco, G., Fiore, S. M., Garibay, I., Grieman, K., et al. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2153320 · Cited by 501
“Recent research already reported that many challenges have been encountered in the process of developing HCAI systems (Yang et al., 2020).”
Metadata
- Authors
- Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-13
- OpenAlex
- W3032875465
- Semantic Scholar
- 529025645c70a935221bd434484faee695ad0f25
- Cited by
- 622
- References
- 52
- Citations by year
- 2026: 120 · 2025: 134 · 2024: 115 · 2023: 108 · 2022: 79 · 2021: 56 · 2020: 9
- FWCI
- 46.02
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Funders
- The National Institute on Disability Independent Living and Rehabilitation Research (NIDILRR) (90REGE0007)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- human-AI interaction, AI system design, design challenges, unintended consequences of AI, user experience, human-computer interaction design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. https://app.cochat.ai/papers/10.1145/3313831.3376301
- The paper
- Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J. (2020). Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376301
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.