Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
Open accessThe DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Abstract
With the emergence of conversational artificial intelligence (AI) agents, it is important to understand the mechanisms that influence users' experiences of these agents. In this paper, we study one of the most common tools in the designer's toolkit: conceptual metaphors. Metaphors can present an agent as akin to a wry teenager, a toddler, or an experienced butler. How might a choice of metaphor influence our experience of the AI agent? Sampling a set of metaphors along the dimensions of warmth and competence---defined by psychological theories as the primary axes of variation for human social perception---we perform a study $(N=260)$ where we manipulate the metaphor, but not the behavior, of a Wizard-of-Oz conversational agent. Following the experience, participants are surveyed about their intention to use the agent, their desire to cooperate with the agent, and the agent's usability. Contrary to the current tendency of designers to use high competence metaphors to describe AI products, we find that metaphors that signal low competence lead to better evaluations of the agent than metaphors that signal high competence. This effect persists despite both high and low competence agents featuring identical, human-level performance and the wizards being blind to condition. A second study confirms that intention to adopt decreases rapidly as competence projected by the metaphor increases. In a third study, we assess effects of metaphor choices on potential users' desire to try out the system and find that users are drawn to systems that project higher competence and warmth. These results suggest that projecting competence may help attract new users, but those users may discard the agent unless it can quickly correct with a lower competence metaphor. We close with a retrospective analysis that finds similar patterns between metaphors and user attitudes towards past conversational agents such as Xiaoice, Replika, Woebot, Mitsuku, and Tay.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This comparative research has shown that interface metaphors, whether explicitly assigned by designers or implicitly adopted by users, significantly influence users' perceptions and interactions with AI systems.”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [32]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, research shows that CUIs designed using human metaphors set high expectations as users perceive them to be more competent, but with subsequent use, these highly competent metaphors are rejected for metaphors that project less competence [39].”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, Khadpe et al. [32] explored agentic metaphors that portrayed chatbots as different human personas and found that they changed user satisfaction with a system even when the system's capabilities were unchanged.”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“Comparative research on metaphors for AI has demonstrated the impact metaphors can have on user interactions with task-based AI systems, e.g., AI that assists with well-defined tasks such as travel planning [32] or waste sorting [46].”
From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“They found that the choice of metaphor had an impact on users’ pre-use as well as post-use perceptions.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [39]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
The Psychology of Everyday Things
Massaro, D. W., & Norman, D. A. (1990) · The American Journal of Psychology · doi:10.2307/1423268 · Cited by 3,466 · cited 1×
“In HCI, experiences of a system are typically understood as being mediated by a person’s mental model of that system [54].”
BackgroundForming impressions of personality.
Asch, S. E. (1946) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0055756 · Cited by 2,508 · cited 1×
“These two dimensions have proven to far outweigh others and repeatedly come up as prime factors in literature [3, 38, 77].”
BackgroundCuddy, A. J. C., Fiske, S. T., & Glick, P. (2008) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(07)00002-0 · Cited by 2,438 · cited 3×
“if the interaction with the agent is identical in both cases. In this paper, we test the effect of metaphors on evaluations of AI agents. We draw on the Stereotype Content Model (SCM) from psychology [16, 24], which demonstrates that the two dimensionsofwarmthandcompetencearetheprincipalaxesofhumansocialperception.Jud…”
BackgroundMethodInfluentialLinguistic Inquiry and Word Count (LIWC): Pronounced “Luke,” . . . and Other Useful Facts
Chung, C. K., & Pennebaker, J. W. (2012) · Applied Natural Language Processing · doi:10.4018/978-1-60960-741-8.ch012 · Cited by 2,151
The psychology of everyday things
Weld, D. S. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90083-0 · Cited by 2,105
FORMING IMPRESSIONS OF PERSONALITY
Asch, S. E. (1961) · Documents of Gestalt Psychology · doi:10.1525/9780520313514-018 · Cited by 2,081
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016) · Communications of the ACM · doi:10.1145/2818717 · Cited by 1,973
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799 · cited 1×
“ediated by a person’s mental modelofthatsystem[54].Conveyinganeffectiveunderstandingofthesystem’sbehaviorcanenable users to build mental models that increase their desire to cooperate with the system [5, 10, 37, 41]. However, a mental model explanation is insufficient to answer the present question: in the case of Xia…”
BackgroundIntelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685 · cited 1×
“rmth experiences in light of their initial expectation. Previous work has sought explanations for user behavior and evaluations of AI by profiling users [5, 18] or by making the AI more interpretable [9, 44, 60]. However, these approaches fail to explain why otherwise functionally similar systems elicited vastly diffe…”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 4×
“viously, interviews have established that expectations from conversational agents such as Siri, Google Assistant, and Alexa are out of sync with the actual capabilities and performance of the systems [49, 83]. So, after repeatedly hitting the agent’s capability limits, users retreat to using the agents only for menial…”
BackgroundInfluentialJudd, C. M., James-Hawkins, L., Yzerbyt, V., & Kashima, Y. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.6.899 · Cited by 1,061 · cited 1×
“gical theory that articulates two major axes in social perception: warmth and competence. These two dimensions have proven to far outweigh others and repeatedly come up as prime factors in literature [3, 38, 77]. Judgements on warmth and competence Proc. ACM Hum.-Comput. Interact., Vol. 4, No. CSCW2, Article 163. Publ…”
BackgroundThe cognitive underpinnings of effective teamwork: A meta-analysis.
DeChurch, L. A., & Mesmer-Magnus, J. R. (2010) · Journal of Applied Psychology · doi:10.1037/a0017328 · Cited by 1,014 · cited 2×
“Such metaphors are meant to help human-AI collaboration in complex domains by aiding users’ ability to understand and predict the agent’s behavior [5, 18].”
BackgroundFiske, S. T., Xu, J., Cuddy, A. C., & Glick, P. (1999) · Journal of Social Issues · doi:10.1111/0022-4537.00128 · Cited by 908 · cited 1×
“• Warmth: To measure the warmth of the AI system, we draw on different warmth levels articulated in the stereotype content model [25]: 1) “This AI system was (will be) good-natured.”
BackgroundThe design and implementation of Xiaoice, an empathetic social chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020) · Computational Linguistics · doi:10.1162/coli_a_00368 · Cited by 777 · cited 1×
“While Tay’s official Twitter account described it as “Microsoft’s AI fam from the internet that’s got zero chill!”, signaling high competence and low warmth, Xiaoice was setup to be “Sympathetic ear” and an “Empathetic social chatbot” [85], very clearly signaling high warmth and even priming behaviors around warmth su…”
BackgroundThe Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2018) · arXiv · doi:10.48550/arxiv.1812.08989 · Cited by 777 · cited 1×
“While Tay’s official Twitter account described it as “Microsoft’s AI fam from the internet that’s got zero chill!”, signaling high competence and low warmth, Xiaoice was setup to be “Sympathetic ear” and an “Empathetic social chatbot” [85], very clearly signaling high warmth and even priming behaviors around warmth su…”
BackgroundFrom Eliza to XiaoIce: Challenges and opportunities with social chatbots
Shum, H.-Y., He, X.-D., & Li, D. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700826 · Cited by 749 · cited 2×
“osyncrasies of any particular AI system. We situate our method in goal-oriented conversational agents (or task-focused bots) as these systems represent a broad class of agents in research and product [17, 35, 55, 68, 78, 79]. 3.1 Collaborative AI task Goal-oriented AI systems, such as those for booking flights, hotel…”
BackgroundMethodInfluentialUnderstanding evaluation of faces on social dimensions
Todorov, A., Said, C. P., Engell, A. D., & Oosterhof, N. N. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.10.001 · Cited by 706 · cited 1×
“±0.59 Table 1. Warmth and competence values (average ±standard deviations) for the metaphors we use across the studies. High competence and warmth values are in bold. are made within 100 milliseconds [72] and a change in these traits alone can wholly change impressions [84]. The SCM proposes a quadrant structure and c…”
MethodInfluentialHo, A., Hancock, J., & Miner, A. S. (2018) · Journal of Communication · doi:10.1093/joc/jqy026 · Cited by 629 · cited 2×
“ersational agent We sought a conversational AI agent whose actual performance was strong enough for our result to generalize as the underlying AI models improve. So, following a pattern in prior work [12, 34, 71, 74], we adopt a Wizard-of-Oz study paradigm. We hire and train customer-support professionals from the Upw…”
MethodSelf-citationEslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K., Hamilton, K., & Sandvig, C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 627 · cited 1×
“Our work contributes to a growing body of work in HCI that seeks to understand how people reason about algorithmic systems with the aim of facilitating more informed and engaging interactions [19, 22, 26].”
BackgroundChaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572 · cited 2×
“ersational agent We sought a conversational AI agent whose actual performance was strong enough for our result to generalize as the underlying AI models improve. So, following a pattern in prior work [12, 34, 71, 74], we adopt a Wizard-of-Oz study paradigm. We hire and train customer-support professionals from the Upw…”
Method(2005) · Cited by 505
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466 · cited 3×
“Such metaphors are meant to help human-AI collaboration in complex domains by aiding users’ ability to understand and predict the agent’s behavior [5, 18].”
BackgroundSaygin, A. P., Chaminade, T., Ishiguro, H., Driver, J., & Frith, C. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr025 · Cited by 452 · cited 1×
“The scope of the study was limited to a conversational AI, as an instance of an algorithmic system, where interaction is devoid of strong visual cues [63].”
BackgroundAssimilation and contrast effects of anchoring stimuli on judgments.
Sherif, M., Taub, D., & Hovland, C. I. (1958) · Journal of Experimental Psychology · doi:10.1037/h0048784 · Cited by 417 · cited 5×
“These results align with Contrast Theory [67], which states that users’ evaluations are defined by the difference between their experiences and expectations.”
BackgroundResultInfluentialWired for Speech: How Voice Activates and Advances the Human-Computer Relationship
Callaway, C., & Sima'an, K. (2006) · Computational Linguistics · doi:10.1162/coli.2006.32.3.451 · Cited by 404
Evaluating and Informing the Design of Chatbots
Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196735 · Cited by 376 · cited 2×
“e shown a negative review before using it [58]. Likewise, humor and other human-like characteristics that create high social intelligence expectations can be crucial in producing positive evaluations [36, 48]. Assimilation theory would predict that a metaphor signaling high competence will set positive expectations an…”
BackgroundInfluentialFirst I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375 · cited 1×
“Previous work has looked at how users form informal theories about the technical mechanisms behind of social media feeds [19, 21, 26] and how these “folk theories” drive their interactions with these systems.”
BackgroundMEDIA EQUATION: HOW PEOPLE TREAT COMPUTERS, TELEVISION, AND NEW MEDIA LIKE REAL PEOPLE AND PLACES
Soash, R. L. (1999) · Collection Management · doi:10.1300/j105v24n03_14 · Cited by 344
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277 · cited 4×
“While other expectation shaping mechanisms for AI agents such as tutorials and instructions have been studied [41], the effect of metaphors on user expectations and evaluations have not.”
BackgroundInfluentialChatbots, Humbots, and the Quest for Artificial General Intelligence
Grudin, J., & Jacques, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300439 · Cited by 275 · cited 5×
“Collaboration between people and conversational artificial intelligence (AI) agents—AI systems that communicate through natural language [30]—is now prevalent.”
BackgroundInfluentialDeVito, M. A., Birnholtz, J., Hancock, J. T., French, M., & Liu, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173694 · Cited by 244 · cited 4×
“Users reason about complex algorithmic systems, including news feeds [19], content curation, and recommender”
BackgroundInfluentialSelf-citationWilson, T. D., Lisle, D. J., Kraft, D., & Wetzel, C. G. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.56.4.519 · Cited by 242 · cited 2×
“Prior theory suggests that pre-use expectations of AI systems influence both initial behaviors [31, 40, 76] and long-term behaviors [42], even if the system itself remains unchanged while varying user expectations [58].”
BackgroundPedagogical Agent Design: The Impact of Agent Realism, Gender, Ethnicity, and Instructional Role
Baylor, A. L., & Kim, Y. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30139-4_56 · Cited by 240 · cited 2×
“Race and gender of pedagogical agents affect learning outcomes—agents racialized as Black or female-gendered lead to improved attention and learning [6].”
BackgroundGelman, S. A., & Legare, C. H. (2011) · Annual Review of Anthropology · doi:10.1146/annurev-anthro-081309-145822 · Cited by 232 · cited 1×
“behaves [41]. In the absence of effective mental models of AI systems, users instead develop folk theories — intuitive, informal theories — as expansive guiding beliefs about the system and its goals [26, 29, 45, 64]. Prior work has shown how subjective evaluations of interface agents are strongly influenced by the fa…”
BackgroundThe Role of Affective Expectations in Subjective Experience and Decision-Making
Klaaren, K. J., Hodges, S. D., & Wilson, T. D. (1994) · Social Cognition · doi:10.1521/soco.1994.12.2.77 · Cited by 221 · cited 2×
“s deal with the dual objective of attracting more users and ensuring a positive user experience. 2 RELATED WORK Pre-use expectations play a critical role in users’ initial usage of a system or design [32, 40, 76]. Setting positive or negative expectations colors users’ evaluation of what would otherwise be identical e…”
BackgroundExpectation Confirmation in Technology Use
Brown, S. A., Venkatesh, V., & Goyal, S. (2012) · Information Systems Research · doi:10.1287/isre.1110.0357 · Cited by 212 · cited 1×
“Consistent with prior literature, the effect is greater as the contrast is greater [7, 28].”
Frames: a corpus for adding memory to goal-oriented dialogue systems
El Asri, L., Schulz, H., Sharma, S., Zumer, J., Harris, J., Fine, E., Mehrotra, R., & Suleman, K. (2017) · Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue · doi:10.18653/v1/w17-5526 · Cited by 212 · cited 3×
“s blind to the condition and randomized across conditions for each participant. Participants are first exposed to the agent’s metaphor, then converse with the agent to complete a travel planning task [4]. Our results suggest that, contrary to how designers typically describe their AI agents, low competence metaphors l…”
BackgroundMethodResultInfluentialNeural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. (2019) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000074 · Cited by 209
Escaping from Children's Abuse of Social Robots
Brščić, D., Kidokoro, H., Suehiro, Y., & Kanda, T. (2015) · Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2696454.2696468 · Cited by 204 · cited 1×
“Antisocial behavior leads to verbal disinhibition toward AI systems [69], and in some extreme cases, to physical abuse and even dismemberment [8, 61].”
BackgroundJakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190 · cited 1×
“ediated by a person’s mental modelofthatsystem[54].Conveyinganeffectiveunderstandingofthesystem’sbehaviorcanenable users to build mental models that increase their desire to cooperate with the system [5, 10, 37, 41]. However, a mental model explanation is insufficient to answer the present question: in the case of Xia…”
BackgroundSelf-citationWhose job is it anyway? A study of human-robot interaction in a collaborative task
Hinds, P., Roberts, T., & Jones, H. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_7 · Cited by 173
Modelling user experience with web sites: Usability, hedonic value, beauty and goodness
van Schaik, P., & Ling, J. (2008) · Interacting with Computers · doi:10.1016/j.intcom.2008.03.001 · Cited by 168 · cited 1×
“rgues that users don’t perceive a difference between their pre-use expectations and actual experiences. Prior work supports that, for interactive systems, users’ expectations do influence evaluations [31, 73]. For example, users rate an interactive system higher when they are shown a positive review of that system bef…”
BackgroundI'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Dissecting a Social Botnet: Growth, Content and Influence in Twitter
Abokhodair, N., Yoo, D., & McDonald, D. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.03627 · Cited by 164 · cited 1×
“e (AI) agents—AI systems that communicate through natural language [30]—is now prevalent. As a result, there is increasing interest in designing these agents and studying how users interact with them [1, 14, 23, 30, 49, 66]. While the technical underpinnings of these systems continue to improve, we still lack fundamen…”
BackgroundConceptual Metaphors of Affect
Crawford, L. E. (2009) · Emotion Review · doi:10.1177/1754073908100438 · Cited by 163 · cited 1×
“Conceptual metaphors are short descriptions attached to a system that are suggestive of its functionality and intentions [15, 50].”
BackgroundDissecting a Social Botnet: Growth, Content and Influence in Twitter
Abokhodair, N., Yoo, D., & McDonald, D. W. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675208 · Cited by 162 · cited 1×
“e (AI) agents—AI systems that communicate through natural language [30]—is now prevalent. As a result, there is increasing interest in designing these agents and studying how users interact with them [1, 14, 23, 30, 49, 66]. While the technical underpinnings of these systems continue to improve, we still lack fundamen…”
BackgroundHow safe are service robots in urban environments? Bullying a robot
Salvini, P., Ciaravella, G., Yu, W., Ferri, G., Manzi, A., Mazzolai, B., Laschi, C., Oh, S. R., & Dario, P. (2010) · 19th International Symposium in Robot and Human Interactive Communication · doi:10.1109/roman.2010.5654677 · Cited by 146 · cited 1×
“Antisocial behavior leads to verbal disinhibition toward AI systems [69], and in some extreme cases, to physical abuse and even dismemberment [8, 61].”
BackgroundReceptionist or information kiosk: how do people talk with a robot?
Lee, M. K., Kiesler, S., & Forlizzi, J. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718927 · Cited by 145 · cited 1×
“agents has observed that the mental schemas people apply towards agents affect the way they behave with the agent and it is possible to detect users’ schematic orientation through initial interaction [47]. Diverging from previous work on folk theories, our work takes a complementary route — instead of studying which m…”
BackgroundConceptual Metaphors and Figurative Language Interpretation: Food for Thought?
McGlone, M. S. (1996) · Journal of Memory and Language · doi:10.1006/jmla.1996.0029 · Cited by 143 · cited 1×
“Conceptual metaphors are short descriptions attached to a system that are suggestive of its functionality and intentions [15, 50].”
BackgroundPlease Stop Explaining Black Box Models for High Stakes Decisions.Preprint
Rudin, C. D. (2018) · arXiv (Cornell University) · Cited by 138
Neural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08267 · Cited by 133 · cited 1×
“et of transactional tasks such as appointment booking, scheduling, and purchasing, which require people to engage with the agent in task-focused dialogue to acquire information or complete their task [27]. Inspired by the popular Maluuba Frames [4] data collection task templates, used to evaluate conversational agents…”
MethodFace Value? Exploring the Effects of Embodiment for a Group Facilitation Agent
Shamekhi, A., Liao, Q. V., Wang, D., Bellamy, R. K. E., & Erickson, T. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173965 · Cited by 124
Affective Concomitants of Information on Morality and Competence
Wojciszke, B. (2005) · European Psychologist · doi:10.1027/1016-9040.10.1.60 · Cited by 122 · cited 1×
“These two dimensions have proven to far outweigh others and repeatedly come up as prime factors in literature [3, 38, 77].”
BackgroundGeers, A. L., & Lassiter, G. D. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1999.1377 · Cited by 109 · cited 1×
“Consistent with prior literature, the effect is greater as the contrast is greater [7, 28].”
Neural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. (2019) · now publishers, Inc. eBooks · doi:10.1561/9781680835533 · Cited by 107
Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop
Cranshaw, J., Elwany, E., Newman, T., Kocielnik, R., Yu, B., Soni, S., Teevan, J., & Monroy-Hernández, A. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025780 · Cited by 106 · cited 1×
“As a result, there is increasing interest in designing these agents and studying how users interact with them [1, 14, 23, 30, 49, 66].”
BackgroundHow Do You Want Your Chatbot? An Exploratory Wizard-of-Oz Study with Young, Urban Indians
Medhi Thies, I., Menon, N., Magapu, S., Subramony, M., & O’Neill, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67744-6_28 · Cited by 104 · cited 3×
“So, following a pattern in prior work [12, 34, 71, 74], we adopt a Wizard-of-Oz study paradigm.”
BackgroundMethodChaves, A. P., & Gerosa, M. A. (2020) · Figshare · doi:10.6084/m9.figshare.13207221.v1 · Cited by 97
Chaves, A. P., & Gerosa, M. A. (2020) · Figshare · doi:10.6084/m9.figshare.13207221 · Cited by 96
Too good to be bad: Favorable product expectations boost subjective usability ratings
Raita, E., & Oulasvirta, A. (2011) · Interacting with Computers · doi:10.1016/j.intcom.2011.04.002 · Cited by 90 · cited 3×
“Prior theory suggests that pre-use expectations of AI systems influence both initial behaviors [31, 40, 76] and long-term behaviors [42], even if the system itself remains unchanged while varying user expectations [58].”
BackgroundWhat's the Folk Theory? Reasoning About Cyber-Social SystemsPreprint
French, M., & Hancock, J. T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2910571 · Cited by 85 · cited 6×
“Our work contributes to a growing body of work in HCI that seeks to understand how people reason about algorithmic systems with the aim of facilitating more informed and engaging interactions [19, 22, 26].”
BackgroundMethodResultInfluentialSelf-citationFraming the user experience: information biases on website quality judgement
Hartmann, J., De Angeli, A., & Sutcliffe, A. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357190 · Cited by 82 · cited 1×
“s deal with the dual objective of attracting more users and ensuring a positive user experience. 2 RELATED WORK Pre-use expectations play a critical role in users’ initial usage of a system or design [32, 40, 76]. Setting positive or negative expectations colors users’ evaluation of what would otherwise be identical e…”
BackgroundFair Work: Crowd Work Minimum Wage with One Line of Code
Whiting, M. E., Hugh, G., & Bernstein, M. S. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5283 · Cited by 79 · cited 1×
“t in the experiment only once. Participants were compensated $4 for a survey lasting an average of 15±5 minutes, for a rate of roughly $15/hr in accordance with fair work standards on Mechanical Turk [75]. Participants’ data was discarded if they failed to follow instructions, left the conversation midway or did not f…”
MethodInfluentialSelf-citationKujala, S., Mugge, R., & Miron-Shatz, T. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2016.09.011 · Cited by 74 · cited 6×
“Prior theory suggests that pre-use expectations of AI systems influence both initial behaviors [31, 40, 76] and long-term behaviors [42], even if the system itself remains unchanged while varying user expectations [58].”
BackgroundMethodInfluentialCalendar.Help: Designing a Workflow-Based Scheduling Agent with Humans in the LoopPreprint
Cranshaw, J., Kocielnik, R., Yu, B., & Teevan, J. B. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2940295 · Cited by 67
An Exploration of the Relation Between Expectations and User Experience
Michalco, J., Simonsen, J. G., & Hornbæk, K. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1065696 · Cited by 63 · cited 1×
“ent in the contrast to discovering the system’s actual limits [49]. Likewise, ratings of interactive games are driven in part by contrasting players experiences against their expectations of the game [51]. Contrast theory predicts that positive metaphors will backfire because AI agents inevitably make mistakes and hav…”
BackgroundAttribute dimensions and patterns of trait inferences
Zanna, M. P., & Hamilton, D. L. (1972) · Psychonomic Science · doi:10.3758/bf03328989 · Cited by 61 · cited 1×
“ons) for the metaphors we use across the studies. High competence and warmth values are in bold. are made within 100 milliseconds [72] and a change in these traits alone can wholly change impressions [84]. The SCM proposes a quadrant structure and cognitive notions of warmth and competence- better understood as discre…”
BackgroundAgent, Gatekeeper, Drug Dealer: How Content Creators Craft Algorithmic Personas
Wu, E. Y., Pedersen, E., & Salehi, N. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359321 · Cited by 52 · cited 2×
“s to express their understanding of the system. For instance, Google describes its search algorithm as a “robotic nose” [26] and YouTube users think of the recommendation algorithm as a “drug dealer” [81]. Starting with the desktop metaphor for personal computing in the Xerox Star [39], conceptual metaphors proliferat…”
BackgroundMethodHelping Not Hurting: Applying the Stereotype Content Model and BIAS Map to Social Robotics
Mieczkowski, H., Liu, S. X., Hancock, J., & Reeves, B. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673307 · Cited by 49 · cited 2×
“tention to adopt index (α = 0.98). To understand the participants’ desire to cooperate, we use questions about behavioral tendencies towards stereotyped groups adapted to the context of social robots [52]. Users are asked on a 5 point Likert scale: “How likely would you be to cooperate with this AI?” and “How likely w…”
BackgroundMethodInfluentialSelf-citationIt Takes a Village: Integrating an Adaptive Chatbot into an Online Gaming Community
Seering, J., Luria, M., Ye, C., Kaufman, G., & Hammer, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376708 · Cited by 49 · cited 1×
“”) Another approach might be to age the metaphor over time: to present a high competence metaphor such as a professional, but when a user first encounters it, the agent introduces itself via a lower-competence version such as a professional trainee and tells the user that it will evolve over time into a full professio…”
BackgroundRudin, C. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.10154 · Cited by 44 · cited 1×
“Previous work has sought explanations for user behavior and evaluations of AI by profiling users [5, 18] or by making the AI more interpretable [9, 44, 60].”
BackgroundStrait, M., Ramos, A. S., Contreras, V., & Garcia, N. (2018) · 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2018.8525610 · Cited by 35
An Empirical Study of the Effect of Agent Competence on User Performance and Perception
Xiao, J., Stasko, J., & Catrambone, R. (2004) · doi:10.1109/aamas.2004.61 · Cited by 32 · cited 1×
“Prior work has shown how subjective evaluations of interface agents are strongly influenced by the face, voice, and other design aspects of the agent [53, 82], beyond just the actual capabilities of the agent.”
BackgroundHuman-in-the-Loop Interpretability Prior
Lage, I. (2024) · PubMed · doi:10.57702/j7gpfk6v · Cited by 31
AI-Based Request Augmentation to Increase Crowdsourcing Participation
Park, J., Krishna, R., Khadpe, P., Fei-Fei, L., & Bernstein, M. S. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5282 · Cited by 23 · cited 1×
“With the recent glut of Twitter bots and other social agents that learn from their interactions and are adaptive in nature [56], it also becomes important to understand what drives users’ antisocial behaviour towards such bots and what factors contribute to antisocial behavior.”
BackgroundSelf-citationFrames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
(2017) · doi:10.48550/arxiv.1704.00057 · Cited by 21 · cited 3×
“s blind to the condition and randomized across conditions for each participant. Participants are first exposed to the agent’s metaphor, then converse with the agent to complete a travel planning task [4]. Our results suggest that, contrary to how designers typically describe their AI agents, low competence metaphors l…”
BackgroundMethodResultInfluentialVerbal Disinhibition towards Robots is Associated with General AntisocialityPreprint
Strait, M. K., Contreras, V., & Vela, C. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01076 · Cited by 9 · cited 1×
“Antisocial behavior leads to verbal disinhibition toward AI systems [69], and in some extreme cases, to physical abuse and even dismemberment [8, 61].”
BackgroundRuuh: A Deep Learning Based Conversational Social AgentPreprint
Damani, S., Raviprakash, N., Gupta, U., Chatterjee, A., Joshi, M., Gupta, K., Narahari, K. N., Agrawal, P., Chinnakotla, M. K., Magapu, S., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12097 · Cited by 7 · cited 1×
“We situate our method in goal-oriented conversational agents (or task-focused bots) as these systems represent a broad class of agents in research and product [17, 35, 55, 68, 78, 79].”
MethodForming Impressions of Personality
Asch, S. E. (2004) · Psychology Press eBooks · doi:10.4324/9780203496398-22 · Cited by 7
Research works printed but not linked: 11
- 10.5555/371552.371555 · doi:10.5555/371552.371555
- Elaine Chang and Vishwac Kannan. 2018. Conversational AI: Best practices for building bots. https://medius.studios.ms/Embed/Video/BRK3225
- Ana Paula Chaves and Marco Auré lio Gerosa. 2019. How should my chatbot interact? A survey on human-chatbot interaction design. CoRR, Vol. abs/1904.02743 (2019). arxiv: 1904.02743 http://arxiv.org/abs/1904.02743 · arXiv
- 10.1111/0022--4537.00128 · doi:10.1111/0022--4537.00128
- AE Nutt. 2017. The Woebot will see you now. the rise of chatbot therapy: Washington Post (2017).
- James W Pennebaker, Martha E Francis, and Roger J Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates, Vol. 71, 2001 (2001), 2001.
- C. Sandvig. 2015. Seeing the Sort: The Aesthetic and Industrial Defense of 'The Algorithm.'. Journal of the New Media Caucus, 11, 35--51 (2015).
- Robin Sease. 2008. Metaphor's role in the information behavior of humans interacting with computers. Information technology and libraries, Vol. 27, 4 (2008), 9--16.
- Peter Wallis and Emma Norling. 2005. The Trouble with Chatbots: social skills in a social world. Virtual Social Agents, Vol. 29 (2005).
- 10.1037/0022-3514.56.4.519 · DOI · Paper page
- 10.5555/1018409.1018745 · doi:10.5555/1018409.1018745
Cited by
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
“Embracing the vision of multiplying diverse expertise, many scholars describe human-AI augmentation as humans and machines “collaborating” together (e.g., Boyaci et al. 2020, Gao et al. 2021, Khadpe et al. 2020, Puranam 2021, Wilson and Daugherty 2018).”
Explanations Can Reduce Overreliance on AI Systems During Decision-Making
Vasconcelos, H., Jörke, M., Grunde-McLaughlin, M., Gerstenberg, T., Bernstein, M. S., & Krishna, R. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579605 · Cited by 402
“(4) AI design: Although increasing benefits of the following may result in increases in overreliance, designers are also able to manipulate (1) perceived model accuracy [95], (2) AI anthropromorphization [50], and (3) the competence associated with metaphors describing the system [44].”
BackgroundSelf-citationNicolescu, L., & Tudorache, M. T. (2022) · Electronics · doi:10.3390/electronics11101579 · Cited by 280
Gomez, C., Cho, S. M., Ke, S., Huang, C.-M., & Unberath, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1521066 · Cited by 209
“We then analyzed the application domains where these interactions were studied.”
Sycophantic AI decreases prosocial intentions and promotes dependence
Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D., & Jurafsky, D. (2026) · Science · doi:10.1126/science.aec8352 · Cited by 185
Self-citation
Metadata
- Authors
- Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2020-10-14
- Volume
- 4
- Issue
- CSCW2
- Pages
- 1-26
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3047508744
- Cited by
- 183
- References
- 79
- Citations by year
- 2026: 53 · 2025: 40 · 2024: 34 · 2023: 29 · 2022: 18 · 2021: 7 · 2020: 2
- FWCI
- 15.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Brown Institute for Media Innovation
- Toyota Research Institute
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- conceptual metaphor, human-AI collaboration, conversational AI agents, warmth and competence, intention to use, perceived usability, user attitudes toward AI, AI agent design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.