The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition
The DOI matches its Crossref record; 103 of the 105 references it cites were found in a registry or an index.
Abstract
Automatic Gender Recognition (AGR) is a subfield of facial recognition that aims to algorithmically identify the gender of individuals from photographs or videos. In wider society the technology has proposed applications in physical access control, data analytics and advertising. Within academia, it is already used in the field of Human-Computer Interaction (HCI) to analyse social media usage. Given the long-running critiques of HCI for failing to consider and include transgender (trans) perspectives in research, and the potential implications of AGR for trans people if deployed, I sought to understand how AGR and HCI understand the term "gender", and how HCI describes and deploys gender recognition technology. Using a content analysis of papers from both fields, I show that AGR consistently operationalises gender in a trans-exclusive way, and consequently carries disproportionate risk for trans people subject to it. In addition, I use the dearth of discussion of this in HCI papers that apply AGR to discuss how HCI operationalises gender, and the implications that this has for the field's research. I conclude with recommendations for alternatives to AGR, and some ideas for how HCI can work towards a more effective and trans-inclusive treatment of gender.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We emphasize that even with careful consideration of different theoretical understandings and careful assessment of both construct reliability and construct validity, this approach is fraught and likely to cause a variety of fairness-related and other harms [e.g., 8, 22, 33, 35, 44], despite good intentions.”
From Measurement and Fairness (2021) · cites this paper as [33]
Citations
Cites
WEST, C., & ZIMMERMAN, D. H. (1987) · Gender & Society · doi:10.1177/0891243287001002002 · Cited by 8,954 · cited 1×
“The latter is seen to derive from the former: a person’s gender is an inevitable consequence of their sex [101].”
Background(2018) · Cited by 3,510
Sexing the body: gender politics and the construction of sexuality
(2000) · Choice Reviews Online · doi:10.5860/choice.38-0919 · Cited by 3,071
Algorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
West, C., & Zimmerman, D. H. (2009) · Gender & Society · doi:10.1177/0891243208326529 · Cited by 1,120
Gender: An Ethnomethodological Approach
Kessler, S. J., & McKenna, W. (1978) · Medical Entomology and Zoology · Cited by 1,007
Gender: An Ethnomethodological Approach
Stoneall, L., Kessler, S., & McKenna, W. (1979) · Contemporary Sociology · doi:10.2307/2064613 · Cited by 912
Invisible Lives: The Erasure of Transsexual and Transgendered People
Chen-Hayes, S. F., & Namaste, V. K. (2002) · Contemporary Sociology · doi:10.2307/3089651 · Cited by 905
Schilt, K., & Westbrook, L. (2009) · Gender & Society · doi:10.1177/0891243209340034 · Cited by 788
Managing uncertainty: A grounded theory of stigma in transgender health care encounters
Poteat, T., German, D., & Kerrigan, D. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.02.019 · Cited by 740
Research works printed but not linked: 13
- Catherine Connell. 2011. Transgender and Genderqueer Workers Negotiating "the Bathroom Question". In Embodied Resistance: Challenging the Norms, Breaking the Rules, Chris Bobel & Samantha Kwan (Ed.). Vanderbilt University Press, New York.
- Sing Tao Daily. 2017. Xindi Mall Extension Technology Application Human Face Recognition System. (Dec 2017). Retrieved April 3, 2018 from http://hd.stheadline.com/news/daily/fin/626442/
- Harold Garfinkel. 1968. The Origins of the Term 'Ethnomethodology'. In Proceedings of the Purdue Symposium on Ethnomethodology. Purdue University, 5--11.
- 10.5555/118850.118953 · doi:10.5555/118850.118953
- J M Grant, L a Mottet, J Tanis, J Harrison, J L Herman, and M Keisling. 2011. Injustice at Every Turn: A Report of the National Transgender Discrimination Survey. Washington National Center for Transgender Equality and National Gay and Lesbian Task Force 25 (2011), 2011.
- Judah HaNasi. 189. Mishnah Bikkurim. In Mishnah. Chapter 4.
- Jody L Herman. 2013. Gendered restrooms and minority stress: The public regulation of gender and its impact on transgender people's lives. Journal of Public Management and Social Policy (2013), 65--80.
- Angela Irvine. 2015. You Can't Run from the Police: Developing a Feminist Criminology that Incorporates Black Transgender Women. Southwest Law Review 44 (2015), 553--561. arXiv:arXiv:1011.1669v3 · arXiv
- Surya Monro. 2010. Towards a Sociology of Gender Diversity. In Transgender Identities: Towards a Social Analysis of Gender Diversity Sally Hines and Tom Sanger (Eds.). Chapter 4.
- Stefanie Mueller, Sean Follmer, Thijs Roumen, and Parinya Punpongsanon. 2017. SCF Summer School. (jul 2017). Retrieved April 12, 2018 from http://scf-summerschool.com/
- Samantha Janette Rippetoe. 2017. House Bill 2 and the Myth of the Bathroom Predator: Exploring Gendered Assumptions in the Context of "Livable Lives" in Policy Making. Master's thesis. Stanford, CA, USA. Advisor(s) Atchison, Robert J. AAT 10278703.
- Scimago. 2017. Journal Rankings on Computer Vision and Pattern Recognition. Website. (14 November 2017). http://www.scimagojr.com/journalrank.php?category=1707&order=h&ord=desc
- 10.5555/832302.836852 · doi:10.5555/832302.836852
Cited by
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050
Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912
“…2019; Buolamwini and Gebru 2018; Lum and Isaac 2016; Noble 2018; Eubanks 2018), exploitative or extractive data practices (Gray and Suri 2019), and applications of AI that dispossess the identity and resources of vulnerable populations (Green 2019; Keyes 2018; Hanna et al. 2019; Stark 2019).”
BackgroundAnil, R., Dai, A. M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S., Taropa, E., Bailey, P., Chen, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.10403 · Cited by 834
Algorithmic injustice: A relational ethics approach
Birhane, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100205 · Cited by 707
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
Ethical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477
Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing
Raji, I. D., Gebru, T., Mitchell, M., Buolamwini, J., Lee, J., & Denton, R. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375820 · Cited by 299
Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., et al. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604673 · Cited by 279
Demographic Bias in Biometrics: A Survey on an Emerging Challenge
Drozdowski, P., Rathgeb, C., Dantcheva, A., Damer, N., & Busch, C. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2992344 · Cited by 263
Using artificial intelligence in craft education: crafting with text-to-image generative models
Vartiainen, H., & Tedre, M. (2023) · Digital Creativity · doi:10.1080/14626268.2023.2174557 · Cited by 263
“Much has been written about the potential of AI, but the growing extent of tracking, data mining, pro fi ling and modelling has also fuelled anxiety over privacy and security threats, along with resistance to new types of power relationships, total surveillance, algorithmic bias, hybrid in fl uencing, behaviour engineer…”
BackgroundLarge image datasets: A pyrrhic win for computer vision?
Birhane, A., & Prabhu, V. U. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00158 · Cited by 257
Scheuerman, M. K., Paul, J. M., & Brubaker, J. R. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359246 · Cited by 252
Jacobs, A. Z., & Wallach, H. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445901 · Cited by 362
Embracing Four Tensions in Human-Computer Interaction Research with Marginalized People
Liang, C. A., Munson, S. A., & Kientz, J. A. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3443686 · Cited by 238
Scheuerman, M. K., Wade, K., Lustig, C., & Brubaker, J. R. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392866 · Cited by 193
The Nooscope manifested: AI as instrument of knowledge extractivism
Pasquinelli, M., & Joler, V. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01097-6 · Cited by 188
Chancellor, S., Baumer, E. P. S., & De Choudhury, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359249 · Cited by 172
The Impossibility of Automating Ambiguity
Birhane, A. (2021) · Artificial Life · doi:10.1162/artl_a_00336 · Cited by 168
Gender Bias in Machine Translation
Savoldi, B., Gaido, M., Bentivogli, L., Negri, M., & Turchi, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00401 · Cited by 165
Trauma-Informed Computing: Towards Safer Technology Experiences for All
Chen, J. X., McDonald, A., Zou, Y., Tseng, E., Roundy, K. A., Tamersoy, A., Schaub, F., Ristenpart, T., & Dell, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517475 · Cited by 163
Considerations for AI fairness for people with disabilities
Trewin, S., Basson, S., Muller, M., Branham, S., Treviranus, J., Gruen, D., Hebert, D., Lyckowski, N., & Manser, E. (2019) · AI Matters · doi:10.1145/3362077.3362086 · Cited by 143
Designing Trans Technology: Defining Challenges and Envisioning Community-Centered Solutions
Haimson, O. L., Gorrell, D., Starks, D. L., & Weinger, Z. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376669 · Cited by 136
“Automatic gender recognition systems not only exclude many trans people due to binary classification systems and conflation of gender with physical characteristics, but also cause risk, harm, and oppression to those who are misclassified or fear misclassification [33, 38, 49].”
Background“Fairness for unobserved characteristics: insights from technological impacts on queer communities”.
Tomasev, N., McKee, K. R., Kay, J., & Mohamed, S. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462540 · Cited by 70
A Survey of Human Gait-Based Artificial Intelligence Applications
Harris, E., Khoo, I., & Demircan, E. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.749274 · Cited by 165
The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied Interaction
Spiel, K. (2021) · Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction · doi:10.1145/3430524.3440651 · Cited by 125
Bennett, C. L., Gleason, C., Scheuerman, M. K., Bigham, J. P., Guo, A., & To, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445498 · Cited by 128
“For marginalized groups, the misclassification of identity is a form of violence and reflective of greater societal discrimination [11, 17, 50, 53, 54, 64, 99].”
BackgroundRethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches
Weinberg, L. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13196 · Cited by 127
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies
Dev, S., Monajatipoor, M., Ovalle, A., Subramonian, A., Phillips, J., & Chang, K.-W. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.150 · Cited by 123
Zhang, R., Li, H., Meng, H., Zhan, J., Gan, H., & Lee, Y.-C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713429 · Cited by 123
Generative AI and the politics of visibility
Gillespie, T. (2024) · Big Data & Society · doi:10.1177/20539517241252131 · Cited by 122
Cambre, J., & Kulkarni, C. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359325 · Cited by 119
Robot Rights?: Let's Talk about Human Welfare Instead
Birhane, A., & van Dijk, J. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375855 · Cited by 116
Bennett, C. L., Rosner, D. K., & Taylor, A. S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376568 · Cited by 107
Examining the impact of sharing COVID-19 misinformation online on mental health
Verma, G., Bhardwaj, A., Aledavood, T., De Choudhury, M., & Kumar, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-11488-y · Cited by 112
This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359221 · Cited by 111
Human-Computer Insurrection: Notes on an Anarchist HCI
Keyes, O., Hoy, J., & Drouhard, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300569 · Cited by 110
Self-citationWinkle, K., McMillan, D., Arnelid, M., Harrison, K., Balaam, M., Johnson, E., & Leite, I. (2023) · Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3568162.3576973 · Cited by 111
(2020) · doi:10.1145/3386296.3386301 · Cited by 107
Self-citationA little bird told me your gender: Gender inferences in social media
Fosch-Villaronga, E., Poulsen, A., Søraa, R. A., & Custers, B. H. M. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102541 · Cited by 98
Algorithmic inclusion: Shaping the predictive algorithms of artificial intelligence in hiring
Kelan, E. K. (2024) · Human Resource Management Journal · doi:10.1111/1748-8583.12511 · Cited by 106
Murić, G., Lerman, K., & Ferrara, E. (2021) · Journal of Medical Internet Research · doi:10.2196/25379 · Cited by 134
Invited perspectives: How machine learning will change flood risk and impact assessment
Wagenaar, D., Curran, A., Balbi, M., Bhardwaj, A., Soden, R., Hartato, E., Sarica, G. M., Ruangpan, L., Molinario, G., & Lallemant, D. (2020) · Natural hazards and earth system sciences · doi:10.5194/nhess-20-1149-2020 · Cited by 118
Conservative AI and social inequality: conceptualizing alternatives to bias through social theory
Zajko, M. (2021) · AI & SOCIETY · doi:10.1007/s00146-021-01153-9 · Cited by 83
Gender-Inclusive HCI Research and Design: A Conceptual Review
Stumpf, S., Peters, A., Bardzell, S., Burnett, M., Busse, D., Cauchard, J., & Churchill, E. (2020) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000056 · Cited by 91
Joshi, S. D., Koyejo, S., Vijitbenjaronk, W. D., Kim, B., & Ghosh, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09615 · Cited by 90
Break the Loop: Gender Imbalance in Music Recommenders
Ferraro, A., Serra, X., & Bauer, C. (2021) · Proceedings of the 2021 Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446033 · Cited by 92
Klein, L. F., & D’Ignazio, C. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658543 · Cited by 173
Diagnosing Gender Bias in Image Recognition Systems
Schwemmer, C., Knight, C., Bello-Pardo, E. D., Oklobdzija, S., Schoonvelde, M., & Lockhart, J. W. (2020) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023120967171 · Cited by 90
Recommenders with a Mission: Assessing Diversity in News Recommendations
Vrijenhoek, S., Kaya, M., Metoui, N., Möller, J. E., Odijk, D., & Helberger, N. (2021) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446019 · Cited by 137
Freeman, G., Maloney, D., Acena, D., & Barwulor, C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502082 · Cited by 84
Online Transgender Health Information Seeking: Facilitators, Barriers, and Future Directions
Augustaitis, L., Merrill, L. A., Gamarel, K. E., & Haimson, O. L. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445091 · Cited by 82
Patching Gender: Non-binary Utopias in HCI
Spiel, K., Keyes, O., & Barlas, P. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3310425 · Cited by 84
Self-citationUnderstanding and Evaluating Racial Biases in Image Captioning
Zhao, D., Wang, A., & Russakovsky, O. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01456 · Cited by 83
Towards Decolonising Computational Sciences
Birhane, A., & Guest, O. (2021) · Kvinder, Køn & Forskning · doi:10.7146/kkf.v29i2.124899 · Cited by 70
MacArthur, C., Grinberg, A., Harley, D., & Hancock, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445701 · Cited by 109
Time for Historicism in CSCW: An Invitation
Soden, R., Ribes, D., Avle, S., & Sutherland, W. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479603 · Cited by 79
Hicks, M. (2019) · IEEE Annals of the History of Computing · doi:10.1109/mahc.2019.2897667 · Cited by 76
Queer(ing) HCI: Moving Forward in Theory and Practice
Spiel, K., Keyes, O., Walker, A. M., DeVito, M. A., Birnholtz, J., Brulé, E., Light, A., Barlas, P., Hardy, J., Ahmed, A., et al. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3311750 · Cited by 75
Self-citationSpiel, K. (2021) · Designing Interactive Systems Conference 2021 · doi:10.1145/3461778.3462033 · Cited by 76
Sloane, M., & Moss, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0084-6 · Cited by 100
Auto-essentialization: Gender in automated facial analysis as extended colonial project
Scheuerman, M. K., Pape, M., & Hanna, A. (2021) · Big Data & Society · doi:10.1177/20539517211053712 · Cited by 75
Trans Time: Safety, Privacy, and Content Warnings on a Transgender-Specific Social Media Site
Haimson, O. L., Buss, J., Weinger, Z., Starks, D. L., Gorrell, D., & Baron, B. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415195 · Cited by 73
Keyes, O., Hutson, J., & Durbin, M. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3310433 · Cited by 72
Self-citationStark, L., Stanhaus, A., & Anthony, D. L. (2020) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24342 · Cited by 98
Andalibi, N., & Garcia, P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449201 · Cited by 71
Scientism as illusio in HR algorithms: Towards a framework for algorithmic hygiene for bias proofing
Vassilopoulou, J., Kyriakidou, O., Özbilgin, M. F., & Groutsis, D. (2024) · Human Resource Management Journal · doi:10.1111/1748-8583.12430 · Cited by 70
“I Didn’t Know I Looked Angry”: Characterizing Observed Emotion and Reported Affect at Work
Kaur, H., McDuff, D., Williams, A. C., Teevan, J. B., & Iqbal, S. T. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517453 · Cited by 90
Diversity and Inclusion in Artificial Intelligence
Fosch‐Villaronga, E., & Poulsen, A. (2022) · Information technology and law series/Information technology & law series · doi:10.1007/978-94-6265-523-2_6 · Cited by 119
Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing
Raji, I. D., Gebru, T., Mitchell, M., Buolamwini, J., Lee, J., & Denton, E. (2020) · arXiv · doi:10.48550/arxiv.2001.00964 · Cited by 69
Queer In AI: A Case Study in Community-Led Participatory AI
Queerinai, O. O., Ovalle, A., Subramonian, A., Singh, A., Voelcker, C., Sutherland, D. J., Locatelli, D., Breznik, E., Klubicka, F., Yuan, H., et al. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594134 · Cited by 68
Metrics for Dataset Demographic Bias: A Case Study on Facial Expression Recognition
Dominguez-Catena, I., Paternain, D., & Galar, M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3361979 · Cited by 106
Prana, G. A. A., Ford, D., Rastogi, A., Lo, D., Purandare, R., & Nagappan, N. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3092813 · Cited by 66
What is the Point of Fairness? Disability, AI and The Complexity of JusticePreprint
Bennett, C. L., & Keyes, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01024 · Cited by 66
Self-citationUsing Explainability to Help Children UnderstandGender Bias in AI
Melsión, G. I., Torre, I., Vidal, E., & Leite, I. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460719 · Cited by 65
Suresh, H., Movva, R., Dogan, A. L., Bhargava, R., Cruxen, I., Cuba, A. M., Taurino, G., So, W., & D'Ignazio, C. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533132 · Cited by 64
Singh, V. K., Chayko, M., Inamdar, R., & Floegel, D. (2020) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24335 · Cited by 69
“…of images that align with normative conceptions of masculine-presenting bodies is certainly an important finding, the process through which we reached that conclusion reveals wider systemic harms perpetuated by technical systems that cannot account for gender as a spectrum (Keyes, 2018; 2019).”
BackgroundMethodEquity Beyond Bias in Language Technologies for Education
Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4446 · Cited by 62
Women's Perspectives on Harm and Justice after Online Harassment
Im, J., Schoenebeck, S. Y., Iriarte, M. P., Grill, G., Wilkinson, D., Batool, A., Alharbi, R., Funwie, A., Gankhuu, T., Gilbert, É., et al. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555775 · Cited by 94
Detecting Bias with Generative Counterfactual Face Attribute AugmentationPreprint
Denton, E., Hutchinson, B., Mitchell, M., & Gebru, T. (2019) · arXiv (Cornell University) · Cited by 75
Toward a Grassroots Culture of Technology Practice
Ghoshal, S., Mendhekar, R., & Bruckman, A. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392862 · Cited by 60
AI in Global Health: The View from the Front Lines
Ismail, A., & Kumar, N. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445130 · Cited by 59
Cruising Queer HCI on the DL: A Literature Review of LGBTQ+ People in HCI
Taylor, J., Simpson, E., Tran, A.-T., Brubaker, J. R., Fox, S. E., & Zhu, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642494 · Cited by 56
Social Technologies for Digital Wellbeing Among Marginalized Communities
DeVito, M. A., Walker, A. M., Birnholtz, J., Ringland, K., Macapagal, K., Kraus, A., Munson, S., Liang, C., & Saksono, H. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359442 · Cited by 55
Sociocultural Dimensions of Tracking Health and Taking Care
Bhat, K., & Kumar, N. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415200 · Cited by 64
Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-Based Recruitment
Peña, A., Serna, I., Morales, A., Fiérrez, J., Ortega, A., Sánchez, A. H., Saéz, M. A., & Ortega-García, J. (2023) · SN Computer Science · doi:10.1007/s42979-023-01733-0 · Cited by 98
A Hierarchy of Limitations in Machine Learning
Malik, M. M. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2002.05193 · Cited by 51
Nova, F. F., DeVito, M. A., Saha, P., Rashid, K. S., Roy Turzo, S., Afrin, S., & Guha, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449231 · Cited by 51
Mitigating Bias in Algorithmic Systems—A Fish-eye View
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2023) · ACM Computing Surveys · doi:10.1145/3527152 · Cited by 52
On Scaling Up a Multilingual Vision and Language Model
Chen, X., Djolonga, J., Padlewski, P., Mustafa, B., Changpinyo, S., Wu, J., Riquelme, C., Goodman, S., Wang, X., Tay, Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01368 · Cited by 379
Fox, S., Menking, A., Eschler, J., & Backonja, U. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3397178 · Cited by 63
Offenwanger, A., Milligan, A. J., Chang, M., Bullard, J., & Yoon, D. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445383 · Cited by 64
Truth from the machine: artificial intelligence and the materialization of identity
Keyes, O., Hitzig, Z., & Blell, M. (2021) · Interdisciplinary Science Reviews · doi:10.1080/03080188.2020.1840224 · Cited by 51
Self-citationAndrus, M., & Villeneuve, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533226 · Cited by 51
Designing Technology to Support Safety for Transgender Women & Non-Binary People of Color
Starks, D. L., Dillahunt, T., & Haimson, O. L. (2019) · Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion · doi:10.1145/3301019.3323898 · Cited by 51
Theories of ”gender” in NLP bias research
Devinney, H., Björklund, J., & Björklund, H. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534627 · Cited by 49
Cao, Y. T., & Daumé, H. (2021) · Computational Linguistics · doi:10.1162/coli_a_00413 · Cited by 47
Examining the Use of Online Platforms for Employment: A Survey of U.S. Job Seekers
Dillahunt, T. R., Israni, A., Lu, A. J., Cai, M., & Hsiao, J. C.-Y. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445350 · Cited by 69
Metadata
- Authors
- Keyes, O.
- Affiliations
- University of Washington (US)
- Corresponding author
- Keyes, Os
- ORCID
- Keyes, Os
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2018-11
- Volume
- 2
- Issue
- CSCW
- Pages
- 1-22
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2899136066
- Cited by
- 505
- References
- 105
- Citations by year
- 2026: 61 · 2025: 67 · 2024: 65 · 2023: 63 · 2022: 71 · 2021: 86 · 2020: 52 · 2019: 39 · 2018: 1
- FWCI
- 88.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Psychology › Social Psychology › LGBTQ Health, Identity, and Policy
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- face recognition, transgender people, misgendering, transgender inclusion, social media analytics, algorithmic risk, human-computer interaction research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.