Should Alexa be a Police Officer, a Doctor, or a Priest?: Towards CUI Relationships Worth Having
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Would you trust your gossiping nosey neighbour to look after your house while you are away? Despite being sold the idea of a conversational user interface (CUI) as a trustworthy, helpful, and non-judgmental mate, the reality that many CUI users face is a relationship characterised by uncertainty and volatility, owing to the CUI's ambiguous social role. To escape the Weisserian nightmare of the ubiquitous, ambiguous, and manipulative CUI, we must first consider the social roles and relationships we encounter every day and use those as models for how future CUIs can be built.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In CUI’22, Simpson & Crone [72] vividly portrayed the potential dystopian consequences of designing CUIs with personas embodying societal roles, such as police officers, doctors, and priests. Their analysis revealed alarming outcomes, including the erosion of trust and the persistent manipulation of user behavior.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [72]
Citations
Cites
The Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians
Asan, O., Bayrak, A. E., & Choudhury, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15154 · Cited by 825
Explainable AI: A Brief Survey on History, Research Areas, Approaches and Challenges
Xu, F., Uszkoreit, H., Du, Y., Fan, W., Zhao, D., & Zhu, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32236-6_51 · Cited by 758 · cited 1×
“Indeed, one of the aims of the Explainable AI movement [23] is to increase the transparency of otherwise opaque AI models that make decisions which could impact the lives of millions.”
BackgroundPrinciples of evidence based medicine
Akobeng, A. K. (2005) · Archives of Disease in Childhood · doi:10.1136/adc.2005.071761 · Cited by 413
Bickmore, T. W., Trinh, H., Olafsson, S., O'Leary, T. K., Asadi, R., Rickles, N. M., & Cruz, R. (2018) · Journal of Medical Internet Research · doi:10.2196/11510 · Cited by 308 · cited 1×
“However, such a portrayal avoids the often-harsh truth, which is rarely disclosed to users: the CUI can be a nosey neighbour that gossips about you and can even put your health at risk [7, 28].”
BackgroundCan computer-generated speech have gender?: an experimental test of gender stereotype
Lee, E. J., Nass, C., & Brave, S. (2000) · CHI '00 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/633292.633461 · Cited by 179 · cited 1×
“Indeed, prior studies have shown that people assign CUIs gender [12] and emotion[15], often struggling to disambiguate whether they are conversing with a human or machine [22, 24].”
BackgroundVoice assistants and older people: some open issues
Sayago, S., Neves, B. B., & Cowan, B. R. (2019) · Proceedings of the 1st International Conference on Conversational User Interfaces · doi:10.1145/3342775.3342803 · Cited by 97
Siri, Echo and Performance: You have to Suffer Darling
Aylett, M. P., Cowan, B. R., & Clark, L. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3310422 · Cited by 50 · cited 1×
“The CUI’s social relationship with the user becomes a promise, rather than a mere performance that veneers a harsh truth of ambiguity and resulting deception [6].”
BackgroundProceedings of the 2nd Conference on Conversational User Interfaces
Torres, M. I., Spain, C. '. 2. C. O. C. U. I. 2. B., & Association for Computing Machinery-Digital Library (2020) · doi:10.1145/3405755 · Cited by 32
Daisy: A Friendly Conversational Agent for Older Adults
Simpson, J., Gaiser, F., Macík, M., & Breßgott, T. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406166 · Cited by 25 · cited 2×
“Third, some CUIs have broached sensitive social issues that prior technologies have avoided, such as loneliness in older adults[18] and disclosure assistance for individuals with disabilities[13].”
BackgroundSelf-citationSpeech diversity and speech interfaces: considering an inclusive future through stammering
Clark, L., Cowan, B. R., Roper, A., Lindsay, S., & Sheers, O. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406139 · Cited by 25
Proceedings of the 17th International Web for All Conference
Duarte, C., & Taiwan, W. '. 1. W. F. A. C. 2. T. (2020) · doi:10.1145/3371300 · Cited by 10
Smemo: a Multi-modal Interface Promoting Children's Creation of Personal Conversational Agents
Cutrupi, C. M., Fadda, S., Valcarenghi, G., Cosentino, G., Catania, F., Spitale, M., & Garzotto, F. (2020) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3405755.3406162 · Cited by 8 · cited 1×
“In recent years, the conversational user interface (CUI) community has concerned itself with designing CUIs that are inclusive to a wider audience, including older adults [16, 17, 20], those with accessibility needs [8], and even children [9].”
BackgroundMack, K., McDonnell, E., Jain, D., Lu Wang, L., E. Froehlich, J., & Findlater, L. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445412 · Cited by 7 · cited 1×
“design for users, regardless of ethnicity [25] or ability [14].”
BackgroundProceedings of the 3rd Conference on Conversational User Interfaces
Kiesel, J., Spina, D., Wachsmuth, H., & Stein, B. (2021) · doi:10.1145/3469595 · Cited by 7
Towards a New generation of Personalized Intelligent Conversational Agents
Hendrickx, I., Cena, F., Başar, E., Di, L., Kunneman, F., Musi, E., Musto, C., Rapp, A., & van Waterschoot, J. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450614.3461453 · Cited by 4 · cited 1×
“They persist longer than a simple dialog box, with many CUIs now boasting the ability to maintain conversational history and build user personalisation over time [5, 11].”
BackgroundWhoever Controls the Media, Controls the VUI
Sin, J., & Munteanu, C. (2020) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3405755.3406159 · Cited by 2 · cited 1×
“In recent years, the conversational user interface (CUI) community has concerned itself with designing CUIs that are inclusive to a wider audience, including older adults [16, 17, 20], those with accessibility needs [8], and even children [9].”
BackgroundAmazon Echo’s privacy issues go way beyond voice recordings
Benjamin, G. (2020) · The Conversation · doi:10.64628/ab.ksjqvcams · Cited by 2
Research works printed but not linked: 10
- Amazon. 2020. Alexa Care Hub. Retrieved March 21, 2021 from https://www.amazon.com/Alexa-Care-Hub/b?ie=UTF8&node=21390531011
- Amazon. 2021. Amazon.com Help: Require Voice Codes for Purchases with Alexa. Retrieved April 15, 2021 from https://www.amazon.com/gp/help/customer/display.html?nodeId=GAA2RYUEDNT5ZSNK
- 10.18653/v1 · DOI
- Marta Perez Garcia, Sarita Saffon Lopez, and Hector Donis. 2018. Everybody is talking about voice activated virtual assistants, but how are people really adopting and using them? lessons from a multi-country study. In Proceedings of the 32nd Human Computer Interaction Conference. BCS.
- Clifford Nass, Ulla Foehr, Scott Brave, and Michael Somoza. 2001. The effects of emotion of voice in synthesized and recorded speech. In Proceedings of the AAAI symposium emotional and intelligent II: The tangled knot of social cognition.
- 10.1109/mprv.2002.993141 · doi:10.1109/mprv.2002.993141
- New Ontario rule banning carding by police takes effect | CBC News. Retrieved April 23, 2022 from https://www.cbc.ca/news/canada/toronto/carding-ontario-police-government-ban-1.3918134
- Three former Minneapolis police officers found guilty of depriving George Floyd of his rights before his death - ABC News. Retrieved April 23, 2022 from https://www.abc.net.au/news/2022-02-25/jury-finds-three-police-officers-guilty-george-floyd-death/100860414
- The Seal of the Confessional. Retrieved April 23, 2022 from https://www.catholiceducation.org/en/religion-and-philosophy/catholic-faith/the-seal-of-the-confessional.html
- Therapy via conversational design | by Kathleen Varghese | UX Collective. Retrieved April 23, 2022 from https://uxdesign.cc/therapy-via-conversational-design-41dc42f85541
Cited by
Chatbots With Attitude: Enhancing Chatbot Interactions Through Dynamic Personality Infusion
Kovačević, N., Boschung, T., Holz, C., Groß, M. H., & Wampfler, R. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665543 · Cited by 31
Examining Humanness as a Metaphor to Design Voice User Interfaces
Desai, S., Dubiel, M., & Leiva, L. A. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665535 · Cited by 21
“…in CUI’21, Pradhan & Lazar [63] raised the ethical issues with designing human-like personas, highlighting how the default voices of commercial VUIs often resemble “white women from the West” and emphasized that crafting female personas in subordinate roles can perpetuate existing societal biases.”
BackgroundAudience design and egocentrism in reference production during human-computer dialogue
Peña, P. R., Doyle, P. R., Edwards, J., Garaialde, D., Rough, D. J., Bleakley, A., Clark, L., Tobar-Henríquez, A., Branigan, H. P., Gessinger, I., et al. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103058 · Cited by 20
Toward Metaphor-Fluid Conversation Design for Voice User Interfaces
Desai, S., Chin, J., Wang, D., Cowan, B. R., & Twidale, M. B. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816223 · Cited by 16
Personas Evolved: Designing Ethical LLM-Based Conversational Agent Personalities
Desai, S., Dubiel, M., Zargham, N., Mildner, T., & Spillner, L. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3728624 · Cited by 14
Metadata
- Authors
- Simpson, J., & Crone, C.
- Affiliations
- Macquarie University (AU)
- Venue
- Proceedings of the 4th Conference on Conversational User Interfaces
- Publisher
- ACM
- Published
- 2022-07-26
- Pages
- 1-5
- OpenAlex
- W4295955083
- Cited by
- 6
- References
- 19
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 2
- FWCI
- 2.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Conversational User Interfaces (CUI) (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- conversational interfaces, social roles, human-AI relationship, trust, ambiguity, ubiquitous computing, manipulative technologies, social role models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.