Great Chain of Agents: The Role of Metaphorical Representation of Agents in Conversational Crowdsourcing
Open accessThe DOI matches its Crossref record; 78 of the 79 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Conversational agents are being widely adopted across several domains to serve a variety of purposes ranging from providing intelligent assistance to companionship. Recent literature has shown that users develop intuitive folk theories and a metaphorical understanding of conversational agents (CAs) due to the lack of a mental model of the agents. However, investigation of metaphorical agent representation in the HCI community has mainly focused on the human level, despite non-human metaphors for agents being prevalent in the real world. We adopted Lakoff and Turner’s ‘Great Chain of Being’ framework to systematically investigate the impact of using non-human metaphors to represent conversational agents on worker engagement in crowdsourcing marketplaces. We designed a text-based conversational agent that assists crowd workers in task execution. Through a between-subjects experimental study (N = 341), we explored how different human and non-human metaphors affect worker engagement, the perceived cognitive load of workers, intrinsic motivation, and their trust in the agents. Our findings bridge the gap of how users experience CAs with non-human metaphors in the context of conversational crowdsourcing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“They found that the human metaphor had no significant difference in chatbot evaluation over non-human metaphors.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [38]
In the citing paper
“Jung et al.’s investigation [38] into chat-based conversational interfaces, employing the GCOB framework, revealed that the in-organic object metaphor notably diverged in perception from the human metaphor.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [38]
In the citing paper
“Preliminary evidence (albeit for chatbots) suggests that non-human metaphors (e.g., animal, plant, object) could be useful in increasing user engagement and perceived workload [38] in comparison to human metaphors.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [38]
In the citing paper
“Further, drawing on findings from prior research [38, 39] that users more favorably receive metaphors signaling high competence and warmth, we opted for ‘doctor’ as the human metaphor and ‘health encyclopedia’ as the non-human metaphor within the health domain.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [38]
In the citing paper
“Most prominently, Jung et al. [38] found that a ‘book’ metaphor resulted in lower enjoyment and engagement of tasks compared to a ‘human’ metaphor; however, the book metaphor also resulted in reduced cognitive load.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364 · cited 4×
“As a previous study from Khadpe et al. [56] drew upon, the Stereotype Content Model (SCM) [27] was used to sample metaphors coherently.”
MethodInfluentialNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297
The Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542
User Centered System Design: New Perspectives on Human-computer Interaction
Norman, D. A., & Draper, S. W. (1986) · CRC Press eBooks · doi:10.1201/b15703 · Cited by 3,132
McAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Nowak, K. L., & Biocca, F. (2003) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474603322761289 · Cited by 1,141
Proceedings of the 24th International Conference on World Wide Web
(2015) · doi:10.1145/2740908 · Cited by 1,052
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034 · cited 1×
“We adopted the lens of conversational microtask crowdsourcing in this work, where improving worker satisfaction remains a challenge [57].”
O’Brien, H. L., Cairns, P., & Hall, M. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.01.004 · Cited by 1,014
Nasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
Nowak, K. L., & Rauh, C. (2005) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2006.tb00308.x · Cited by 556
More than cool reason: a field guide to poetic metaphor
(1989) · Choice Reviews Online · doi:10.5860/choice.27-1369 · Cited by 503
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476
Garau, M., Slater, M., Vinayagamoorthy, V., Brogni, A., Steed, A., & Sasse, M. A. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642703 · Cited by 441
First I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375
Cultivating admiration in brands: Warmth, competence, and landing in the “golden quadrant”
Aaker, J. L., Garbinsky, E. N., & Vohs, K. D. (2012) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.11.012 · Cited by 355
Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents
Bickmore, T. W., Pfeifer, L. M., & Jack, B. W. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518891 · Cited by 289
Sustained work, fatigue, sleep loss and performance: A review of the issues
Krueger, G. P. (1989) · Work & Stress · doi:10.1080/02678378908256939 · Cited by 284
Chatbots, Humbots, and the Quest for Artificial General Intelligence
Grudin, J., & Jacques, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300439 · Cited by 275 · cited 2×
“In this research, we focus on chatbots [39, 104].”
BackgroundMethodExternal manifestations of trustworthiness in the interface
Cassell, J., & Bickmore, T. (2000) · Communications of the ACM · doi:10.1145/355112.355123 · Cited by 255
The reification of metaphor as a design tool
Blackwell, A. F. (2006) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1188816.1188820 · Cited by 253
A “pile” metaphor for supporting casual organization of information
Mander, R., Salomon, G., & Wong, Y. Y. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.143055 · Cited by 214
Siles, I., Segura-Castillo, A., Solís, R., & Sancho, M. (2020) · Big Data & Society · doi:10.1177/2053951720923377 · Cited by 211
Agents with faces: the effect of personification
Koda, T., & Maes, P. (2002) · Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA · doi:10.1109/roman.1996.568812 · Cited by 210
Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415234 · Cited by 183 · cited 10×
“As a result, we chose “dog” as a metaphor to represent an Animal agent [93] and “trained professional” as a metaphor to represent a Human agent [56].”
BackgroundMethodResultInfluentialThe Influence of Anthropomorphism and Agency on Social Judgment in Virtual Environments
Nowak, K. L. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2004.tb00284.x · Cited by 167
McInnis, B. J., Cosley, D., Nam, C., & Leshed, G. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858539 · Cited by 166
Face Value? Exploring the Effects of Embodiment for a Group Facilitation Agent
Shamekhi, A., Liao, Q., Wang, D., Bellamy, R., & Erickson, T. D. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173965 · Cited by 161
Receptionist or information kiosk: how do people talk with a robot?
Lee, M. K., Kiesler, S., & Forlizzi, J. (2010) · Proceedings of the 2010 ACM conference on Computer supported cooperative work · doi:10.1145/1718918.1718927 · Cited by 145
Weitz, K., Schiller, D., Schlagowski, R., Huber, T., & André, E. (2019) · Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3308532.3329441 · Cited by 136
Gannon, M. J., & Pillai, R. (2010) · Sage eBooks · doi:10.4135/9781452224886 · Cited by 134
Wang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445645 · Cited by 120 · cited 1×
“This has contributed to a steep rise in the use of conversational agents across several domains [41, 46, 51, 101].”
BackgroundA taxonomy of microtasks on the web
Gadiraju, U., Kawase, R., & Dietze, S. (2014) · Proceedings of the 25th ACM conference on Hypertext and social media · doi:10.1145/2631775.2631819 · Cited by 116
Self-citationAlexa, My Love: Analyzing Reviews of Amazon Echo
Gao, Y., Pan, Z., Wang, H., & Chen, G. (2018) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld.2018.00094 · Cited by 115
HALKIAS, G. T., & Diamantopoulos, A. (2020) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2020.02.004 · Cited by 115
Warmth and competence in animals
Sevillano, V., & Fiske, S. T. (2015) · Journal of Applied Social Psychology · doi:10.1111/jasp.12361 · Cited by 112
Han, X., Zhou, M., Turner, M. J., & YEH, T. P. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445569 · Cited by 112
Jackendoff, R. S., & Aaron, D. H. (1991) · Language · doi:10.2307/415109 · Cited by 91
What's the Folk Theory? Reasoning About Cyber-Social SystemsPreprint
French, M., & Hancock, J. T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2910571 · Cited by 85
SearchBots: User Engagement with ChatBots during Collaborative Search
Avula, S., Chadwick, G., Arguello, J., & Capra, R. (2018) · Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - CHIIR '18 · doi:10.1145/3176349.3176380 · Cited by 80
The universality of warmth and competence: A response to brands as intentional agents
Bennett, A. M., & Hill, R. P. (2012) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.10.005 · Cited by 79
Social Drone Companion for the Home Environment: a User-Centric Exploration
Karjalainen, K. D., Romell, A. E. S., Ratsamee, P., Yantaç, A. E., Fjeld, M., & Obaid, M. (2017) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3125739.3125774 · Cited by 76
IdeaBot: Investigating Social Facilitation in Human-Machine Team Creativity
Hwang, A. H.-C., & Won, A. S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445270 · Cited by 72
Theoretical considerations and development of a questionnaire to measure trust in automation
Körber, M. (2018) · doi:10.31234/osf.io/nfc45 · Cited by 71
Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time
Huang, T.-H. (., Chang, J. C., & Bigham, J. P. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173869 · Cited by 68
Second Chance for a First Impression? Trust Development in Intelligent System Interaction
Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., & Bernstein, A. (2021) · Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3450613.3456817 · Cited by 67 · cited 1×
“TiA is a validated questionnaire [59] that has been widely used to measure trust in human-AI interaction [98, 102].”
BackgroundSelf-citationImproving Worker Engagement Through Conversational Microtask Crowdsourcing
Qiu, S., Gadiraju, U., & Bozzon, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376403 · Cited by 65
Self-citationAnd Now for Something Completely Different: Improving Crowdsourcing Workflows with Micro-Diversions
Dai, P., Rzeszotarski, J. M., Paritosh, P., & Chi, E. H. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675260 · Cited by 62
An exploratory study of using 3D avatars as online salespeople
Mull, I. R., Wyss, J., Moon, E., & Lee, S. (2015) · Journal of Fashion Marketing and Management · doi:10.1108/jfmm-05-2014-0033 · Cited by 60
The Impact of Task Abandonment in Crowdsourcing
Han, L., Roitero, K., Gadiraju, U., Sarasua, C., Checco, A., Maddalena, E., & Demartini, G. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2948168 · Cited by 60
Self-citationA Look at the Roles of Look & Roles in Embodied Pedagogical Agents – A User Preference Perspective
Haake, M., & Gulz, A. (2009) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2009-19(1)03 · Cited by 59
Catering to the crowd: An HRM perspective on crowd worker engagement
Bush, J. T., & Balven, R. M. (2018) · Human Resource Management Review · doi:10.1016/j.hrmr.2018.10.003 · Cited by 55
All Those Wasted Hours: On Task Abandonment in Crowdsourcing
Han, L., Roitero, K., Gadiraju, U., Sarasua, C., Checco, A., Maddalena, E., & Demartini, G. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3291035 · Cited by 55
Self-citationMoore, R. J., Arar, R., Ren, G.-J., & Szymanski, M. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3027077 · Cited by 53
The Effects of Warmth and Competence Perceptions on Users' Choice of an AI System
Gilad, Z., Amir, O., & Levontin, L. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3446863 · Cited by 53
Blythe, M., & Buie, E. A. (2014) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2639189.2641212 · Cited by 49
Improving learning through achievement priming in crowdsourced information finding microtasks
Gadiraju, U., & Dietze, S. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027402 · Cited by 45
Self-citationGenie in the Bottle: Anthropomorphized Perceptions of Conversational Agents
Kuzminykh, A., Sun, J., Govindaraju, N., Avery, J., & Lank, E. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376665 · Cited by 41
Gammoh, B. S., Jiménez, F. R., & Wergin, R. (2018) · International Journal of Electronic Commerce · doi:10.1080/10864415.2018.1462939 · Cited by 39
Curious Cat--Mobile, Context-Aware Conversational Crowdsourcing Knowledge Acquisition
Bradeško, L., Witbrock, M., Starc, J., Herga, Z., Grobelnik, M., & Mladenić, D. (2017) · ACM Transactions on Information Systems · doi:10.1145/3086686 · Cited by 36
Chatterbox: Conversational Interfaces for Microtask Crowdsourcing
Mavridis, P., Huang, O., Qiu, S., Gadiraju, U., & Bozzon, A. (2019) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3320435.3320439 · Cited by 34
Self-citationCrowdCO-OP: Sharing Risks and Rewards in Crowdsourcing
Fan, S., Gadiraju, U., Checco, A., & Demartini, G. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415203 · Cited by 34
Self-citationUsing Worker Avatars to Improve Microtask Crowdsourcing
Qiu, S., Bozzon, A., Birk, M. V., & Gadiraju, U. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476063 · Cited by 29
Self-citationTranscendhance: A Game to Facilitate Techno-Spiritual Design
Buie, E. A. (2016) · CHI Extended Abstracts · doi:10.1145/2851581.2892536 · Cited by 28
SimilarHITs: Revealing the Role of Task Similarity in Microtask Crowdsourcing
Aipe, A., & Gadiraju, U. (2018) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3209542.3209558 · Cited by 26
Self-citationGuo, J., Guo, J., Yang, C., Wu, Y., & Sun, L. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445129 · Cited by 26
Estimating Conversational Styles in Conversational Microtask Crowdsourcing
Qiu, S., Gadiraju, U., & Bozzon, A. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392837 · Cited by 25
Self-citationEow, Y. L., Ali, W. Z. B. W., Baki, R., & Mahmud, R. B. (2010) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.12973/ejmste/75242 · Cited by 25
Crowd of Oz: A Crowd-Powered Social Robotics System for Stress Management
Abbas, T., Khan, V.-J., Gadiraju, U., Barakova, E. I., & Markopoulos, P. (2020) · Sensors · doi:10.3390/s20020569 · Cited by 24
Self-citationAvatar: a virtual face for the elderly
Cheong, W. L., Jung, Y., & Theng, Y.-L. (2011) · Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry · doi:10.1145/2087756.2087850 · Cited by 23
TickTalkTurk: Conversational Crowdsourcing Made Easy
Qiu, S., Gadiraju, U., & Bozzon, A. (2020) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3406865.3418572 · Cited by 20
Self-citationRevealing the Role of User Moods in Struggling Search Tasks
Xu, L., Zhou, X., & Gadiraju, U. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331353 · Cited by 19
Self-citationQiu, S., Gadiraju, U., & Bozzon, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50578-3_26 · Cited by 10
Self-citationOn the use of XML for port communications
Englert, B., & Lam, S. (2009) · IFAC Proceedings Volumes · doi:10.3182/20090902-3-us-2007.0059 · Cited by 8
Visual Style of Embodied Virtual Sales Agents
Tan, S.-M., Liew, T. W., Gan, C. L., & Wong, W. M. (2020) · International Journal of Technology and Human Interaction · doi:10.4018/ijthi.2021010101 · Cited by 7
A Look at the Roles of Look & Roles in Embodied Pedagogical Agents - A User Preference Perspective
HaakeMagnus, & GulzAgneta (2009) · International Journal of Artificial Intelligence in Education · doi:10.5555/1517338.1517341 · Cited by 5
Choosing Unhealthy to Appear Warm: How Consumers Signal Personality Traits Via Food Choice
Grishin, M., Li, J. Y., Olson, J. G., & Singh, S. N. (2017) · ACR North American Advances · Cited by 2
Research works printed but not linked: 26
- Tahir Abbas , Ujwal Gadiraju , Vassilis-Javed Khan , and Panos Markopoulos . 2021 . Making Time Fly: Using Fillers to Improve Perceived Latency in Crowd-Powered Conversational Systems . In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 9. 2–14 . Tahir Abbas, Ujwal Gadiraju, Vassilis-Javed Khan, and Panos Markopoulos. 2021. Making Time Fly: Using Fillers to Improve Perceived Latency in Crowd-Powered Conversational Systems. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 9. 2–14.
- Tahir Abbas , Vassilis-Javed Khan , Ujwal Gadiraju , and Panos Markopoulos . 2020 . Trainbot: A Conversational Interface to Train Crowd Workers for Delivering On-Demand Therapy . In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 8. 3–12 . Tahir Abbas, Vassilis-Javed Khan, Ujwal Gadiraju, and Panos Markopoulos. 2020. Trainbot: A Conversational Interface to Train Crowd Workers for Delivering On-Demand Therapy. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 8. 3–12.
- Nancy Baym , Limor Shifman , Christopher Persaud , and Kelly Wagman . 2019 . INTELLIGENT FAILURES: CLIPPY MEMES AND THE LIMITS OF DIGITAL ASSISTANTS. AoIR Selected Papers of Internet Research 2019 (2019). Nancy Baym, Limor Shifman, Christopher Persaud, and Kelly Wagman. 2019. INTELLIGENT FAILURES: CLIPPY MEMES AND THE LIMITS OF DIGITAL ASSISTANTS. AoIR Selected Papers of Internet Research 2019 (2019).
- Johanna Böttcher , Tabea Lüttmer , Ulrich Wagner , Frank Asbrock , and Maarten H . W. van Zalk . 2020 . Examining the structural validity of stereotype content measures - A preregistered re-analysis of published data and discussion of psosisble future directions. Vol . 1. 0–2 pages. Johanna Böttcher, Tabea Lüttmer, Ulrich Wagner, Frank Asbrock, and Maarten H. W. van Zalk. 2020. Examining the structural validity of stereotype content measures - A preregistered re-analysis of published data and discussion of psosisble future directions. Vol. 1. 0–2 pages.
- Cynthia Breazeal . 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 ( 2003 ), 167–175. Cynthia Breazeal. 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 (2003), 167–175.
- Ewart J De Visser , Samuel S Monfort , Ryan McKendrick , Melissa AB Smith , Patrick E McKnight , Frank Krueger , and Raja Parasuraman . 2016 . Almost human: Anthropomorphism increases trust resilience in cognitive agents.Journal of Experimental Psychology : Applied 22 , 3 (2016), 331 . Ewart J De Visser, Samuel S Monfort, Ryan McKendrick, Melissa AB Smith, Patrick E McKnight, Frank Krueger, and Raja Parasuraman. 2016. Almost human: Anthropomorphism increases trust resilience in cognitive agents.Journal of Experimental Psychology: Applied 22, 3 (2016), 331.
- Djellel Eddine Difallah , Michele Catasta , Gianluca Demartini , and Philippe Cudré-Mauroux . 2014 . Scaling-up the crowd: Micro-task pricing schemes for worker retention and latency improvement . In Second AAAI Conference on Human Computation and Crowdsourcing. Djellel Eddine Difallah, Michele Catasta, Gianluca Demartini, and Philippe Cudré-Mauroux. 2014. Scaling-up the crowd: Micro-task pricing schemes for worker retention and latency improvement. In Second AAAI Conference on Human Computation and Crowdsourcing.
- Graham Dove . 2020. Monsters, Metaphors, and Machine Learning . ( 2020 ), 1–17 . Graham Dove. 2020. Monsters, Metaphors, and Machine Learning. (2020), 1–17.
- Franz Faul , Edgar Erdfelder , Albert-Georg Lang , and Axel Buchner . 2007. G* Power 3 : A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods 39, 2 ( 2007 ), 175–191. Franz Faul, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods 39, 2 (2007), 175–191.
- Susan A Gelman and Cristine H Legare . 2011. Concepts and folk theories. Annual review of anthropology 40 ( 2011 ), 379–398. Susan A Gelman and Cristine H Legare. 2011. Concepts and folk theories. Annual review of anthropology 40 (2011), 379–398.
- Agneta Gulz . 2006 . Visual Design of Virtual Pedagogical Agents : Naturalism versus Stylization in Static Appearance . 6th International Conference on Intelligent Virtual Agents, IVA 2006 2006 (2006), 1–9. Agneta Gulz. 2006. Visual Design of Virtual Pedagogical Agents : Naturalism versus Stylization in Static Appearance. 6th International Conference on Intelligent Virtual Agents, IVA 2006 2006 (2006), 1–9.
- Sandra G Hart and Lowell E Staveland . 1988. Development of NASA-TLX. Human Mental Workload. Advances in Psychology52 ( 1988 ), 139–183. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX. Human Mental Workload. Advances in Psychology52 (1988), 139–183.
- Ting- Hao Kenneth Huang , Walter S Lasecki , and Jeffrey P Bigham . 2015 . Guardian: A crowd-powered spoken dialog system for web apis . In Third AAAI conference on human computation and crowdsourcing. Ting-Hao Kenneth Huang, Walter S Lasecki, and Jeffrey P Bigham. 2015. Guardian: A crowd-powered spoken dialog system for web apis. In Third AAAI conference on human computation and crowdsourcing.
- Mohammad Hossein Jarrahi , Will Sutherland , Sarah Beth Nelson , and Steve Sawyer . 2020. Platformic management, boundary resources for gig work, and worker autonomy. Computer supported cooperative work (CSCW) 29, 1 ( 2020 ), 153–189. Mohammad Hossein Jarrahi, Will Sutherland, Sarah Beth Nelson, and Steve Sawyer. 2020. Platformic management, boundary resources for gig work, and worker autonomy. Computer supported cooperative work (CSCW) 29, 1 (2020), 153–189.
- George Lakoff and Mark Johnson . 2008. Metaphors we live by . University of Chicago press. George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago press.
- Edward McAuley , Terry Duncan , and Vance V Tammen . 1989. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research quarterly for exercise and sport 60, 1 ( 1989 ), 48–58. Edward McAuley, Terry Duncan, and Vance V Tammen. 1989. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research quarterly for exercise and sport 60, 1 (1989), 48–58.
- Michael F McTear . 2016 . The rise of the conversational interface: A new kid on the block? . In International workshop on future and emerging trends in language technology. Springer, 38–49 . Michael F McTear. 2016. The rise of the conversational interface: A new kid on the block?. In International workshop on future and emerging trends in language technology. Springer, 38–49.
- Jeffrey M Rzeszotarski , Ed Chi , Praveen Paritosh , and Peng Dai . 2013 . Inserting micro-breaks into crowdsourcing workflows . In First AAAI Conference on Human Computation and Crowdsourcing. Jeffrey M Rzeszotarski, Ed Chi, Praveen Paritosh, and Peng Dai. 2013. Inserting micro-breaks into crowdsourcing workflows. In First AAAI Conference on Human Computation and Crowdsourcing.
- Edward Schneider , Yifan Wang , and Shanshan Yang . 2007 . Exploring the Uncanny Valley with Japanese Video Game Characters .. In DiGRA Conference. Edward Schneider, Yifan Wang, and Shanshan Yang. 2007. Exploring the Uncanny Valley with Japanese Video Game Characters.. In DiGRA Conference.
- Robin Sease . 2008. Metaphor’s role in the information behavior of humans interacting with computers. Information technology and libraries 27, 4 ( 2008 ), 9–16. Robin Sease. 2008. Metaphor’s role in the information behavior of humans interacting with computers. Information technology and libraries 27, 4 (2008), 9–16.
- Muzafer Sherif , Daniel Taub , and Carl I Hovland . 1958. Assimilation and contrast effects of anchoring stimuli on judgments.Journal of experimental psychology 55, 2 ( 1958 ), 150. Muzafer Sherif, Daniel Taub, and Carl I Hovland. 1958. Assimilation and contrast effects of anchoring stimuli on judgments.Journal of experimental psychology 55, 2 (1958), 150.
- Astrid M Von der Pütten , Nicole C Krämer , Jonathan Gratch , and Sin-Hwa Kang . 2010. “ It doesn’t matter what you are! ” explaining social effects of agents and avatars.Computers in Human Behavior( 2010 ). Astrid M Von der Pütten, Nicole C Krämer, Jonathan Gratch, and Sin-Hwa Kang. 2010. “It doesn’t matter what you are!” explaining social effects of agents and avatars.Computers in Human Behavior(2010).
- Alan Wexelblat . 1998 . Don’t make that face: A report on anthropomorphizing an interface . Intelligent Environments 173 , 179 (1998), 98 – 02 . Alan Wexelblat. 1998. Don’t make that face: A report on anthropomorphizing an interface. Intelligent Environments 173, 179 (1998), 98–02.
- 10.5555/1870559.1870562 · doi:10.5555/1870559.1870562
- Aiyana K Willard and Rita A McNamara . 2019. The minds of god (s) and humans: Differences in mind perception in Fiji and North America. Cognitive science 43, 1 ( 2019 ), e12703. Aiyana K Willard and Rita A McNamara. 2019. The minds of god (s) and humans: Differences in mind perception in Fiji and North America. Cognitive science 43, 1 (2019), e12703.
- Jie Yang , Judith Redi , Gianluca Demartini , and Alessandro Bozzon . 2016 . Modeling task complexity in crowdsourcing . In Fourth AAAI Conference on human computation and crowdsourcing. Jie Yang, Judith Redi, Gianluca Demartini, and Alessandro Bozzon. 2016. Modeling task complexity in crowdsourcing. In Fourth AAAI Conference on human computation and crowdsourcing.
Cited by
Zhang, R., Duan, W., Flathmann, C., McNeese, N., Freeman, G., & Williams, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610072 · Cited by 134
Park, G., Chung, J., & Lee, S. (2024) · Current Psychology · doi:10.1007/s12144-023-04653-7 · Cited by 84
Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition
Kazemitabaar, M., Williams, J., Drosos, I., Grossman, T., Henley, A. Z., Negreanu, C., & Sarkar, A. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676345 · Cited by 112
How Do Analysts Understand and Verify AI-Assisted Data Analyses?
Gu, K., Shang, R., Althoff, T., Wang, C., & Drucker, S. M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642497 · Cited by 37
Metaphors of AI indicate that people increasingly perceive AI as warm and human-like
Cheng, M., Lee, A. Y., Rapuano, K. M., Niederhoffer, K. G., Liebscher, A., & Hancock, J. T. (2026) · Communications Psychology · doi:10.1038/s44271-025-00376-6 · Cited by 75
Metadata
- Authors
- Jung, J.-Y., Qiu, S., Bozzon, A., & Gadiraju, U.
- Affiliations
- Delft University of Technology (NL)
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-27
- Pages
- 1-22
- OpenAlex
- W4224991000
- Cited by
- 43
- References
- 77
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 10 · 2023: 7 · 2022: 4
- FWCI
- 16.85
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- chatbots, metaphorical representation, Great Chain of Being, employee engagement, cognitive load, intrinsic motivation, trust in agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.