Speaking from Experience: Trans/Non-Binary Requirements for Voice-Activated AI
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Voice-Activated Artificial Intelligence (VAI) is increasingly ubiquitous, whether appearing as context-specific conversational assistants or more personalised and generalised personal assistants such as Alexa or Siri. CSCW and other fields have regularly studied the (positive and negative) social consequences of VAI design and deployment. One particular focus has been questions of gender, and the implications that the (often-feminine) gendering of VAIs has for societal norms and user experiences. Studies into this have largely elided transgender (trans) existences; the few exceptions to this operate largely from an external and predetermined idea of trans and/or non-binary user needs, centered on representation. In this study, we undertook a series of qualitative interviews with trans and/or non-binary users of VAIs to explore their experiences and needs. Our results show that these needs are far more than simply improvements to representation, and that users raise substantial concerns around the underlying framing of gender by even well-intentioned developers, the privacy and safety implications of ubiquitous VAI, and the motivations of the vast for-profit companies that deploy much of this technology. We provide both immediate recommendations for designers and researchers seeking to create trans-inclusive VAIs, and wider, critical proposals for how we as researchers go about assessing technological systems and appropriate points of intervention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition
Keyes, O. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274357 · Cited by 505
Self-citationWhat Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 1×
“This interest in VAI has grown to encompass other social computing-overlapping disciplines and venues, such as human-computer interaction more broadly [9, 14, 45], ubiquitous computing, and information science [38].”
BackgroundEmotional AI: The Rise of Empathic Media
McStay, A. (2018) · doi:10.4135/9781526451293 · Cited by 385
Talk to me: Exploring user interactions with the Amazon Alexa
Lopatovska, I., Rink, K., Knight, I., Raines, K., Cosenza, K., Williams, H., Sorsche, P., Hirsch, D., Li, Q., & Martinez, A. (2019) · Journal of Librarianship and Information Science · doi:10.1177/0961000618759414 · Cited by 298
Asking more of Siri and Alexa: feminine persona in service of surveillance capitalism
Woods, H. S. (2018) · Critical Studies in Media Communication · doi:10.1080/15295036.2018.1488082 · Cited by 222
At Your Service: Designing Voice Assistant Personalities to Improve Automotive User Interfaces
Braun, M., Mainz, A., Chadowitz, R., Pfleging, B., & Alt, F. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300270 · Cited by 182
Star, S. L., & Bowker, G. C. (2007) · Ethics and Information Technology · doi:10.1007/s10676-007-9141-7 · Cited by 142
Designing Trans Technology: Defining Challenges and Envisioning Community-Centered Solutions
Haimson, O. L., Gorrell, D., Starks, D. L., & Weinger, Z. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376669 · Cited by 136 · cited 2×
“Oliver Haimson, Denny Starks and colleagues raise this issue within HCI, noting the tension it produces in designing more inclusive systems [24].”
BackgroundMetatla, O., Oldfield, A., Ahmed, T., Vafeas, A., & Miglani, S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300608 · Cited by 112 · cited 1×
“This interest in VAI has grown to encompass other social computing-overlapping disciplines and venues, such as human-computer interaction more broadly [9, 14, 45], ubiquitous computing, and information science [38].”
BackgroundGender as a Variable in Natural-Language Processing: Ethical Considerations
Larson, B. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1601 · Cited by 111 · cited 1×
“Contextualised within a sociopolitical context where trans individuals experience disproportionate physical violence [37], and digital threats [35, 58], it is crucial that developers support the unsanctioned opting out of data collection by incorporating permissions into service design that ease users’ ability to pers…”
BackgroundTalking with Conversational Agents in Collaborative Action
Porcheron, M., Fischer, J. E., McGregor, M., Brown, B., Luger, E., Candello, H., & O'Hara, K. (2017) · Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3022198.3022666 · Cited by 45 · cited 2×
“Within CSCW, researchers have prototyped novel systems [42], explored users’ perceptions of and practices with existing VAIs [41, 55, 56], and sought to bring researchers together in multiple workshops and panels to discuss the possibilities of these systems [36, 54].”
BackgroundHuman-Agent Communication: Connecting Research and Development in HCI and AI
Liao, Q. V., Wang, Y.-C., Bickmore, T., Fung, P., Grudin, J., Yu, Z., & Zhou, M. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3358607 · Cited by 14
Cited by
Taxonomy of Risks posed by Language Models
Weidinger, L., Uesato, J., Rauh, M., Griffin, C., Huang, P.-S., Mellor, J., Glaese, A., Cheng, M., Balle, B., Kasirzadeh, A., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533088 · Cited by 764
Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., et al. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604673 · Cited by 279
Haimson, O. L., Mayworm, S. R., Ingber, A. S., & Andalibi, N. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732081 · Cited by 25
The ethics of AI at the intersection of transgender identity and neurodivergence
Parks, M. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00257-1 · Cited by 7
Trans Data: A Research and Design Agenda from Trans Activists' Transformative Data Science
Doğan, A. L., Stevens, N., & D'Ignazio, C. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757682 · Cited by 2
Metadata
- Authors
- Rincón, C., Keyes, O., & Cath, C.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-27
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3157125769
- Cited by
- 33
- References
- 13
- FWCI
- 5.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.