From Gender Biases to Gender-Inclusive Design: An Empirical Investigation
The DOI matches its Crossref record, with a small difference in title or year; 45 of the 45 references it cites were found in a registry or an index.
Abstract
In recent years, research has revealed gender biases in numerous software products. But although some researchers have found ways to improve gender participation in specific software projects, general methods focus mainly on detecting gender biases -- not fixing them. To help fill this gap, we investigated whether the GenderMag bias detection method can lead directly to designs with fewer gender biases. In our 3-step investigation, two HCI researchers analyzed an industrial software product using GenderMag; we derived design changes to the product using the biases they found; and ran an empirical study of participants using the original product versus the new version. The results showed that using the method in this way did improve the software's inclusiveness: women succeeded more often in the new version than in the original; men's success rates improved too; and the gender gap entirely disappeared.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When tools misalign with users' cognitive styles [6, 19, 142], they impose additional usability barriers, forcing users to expend extra cognitive effort to achieve the same outcomes.”
From What Needs Attention? Prioritizing Drivers of Developers' Trust and Adoption of Generative AI (2025) · cites this paper as [142]
Citations
Cites
INDIVIDUAL RISK ATTITUDES: MEASUREMENT, DETERMINANTS, AND BEHAVIORAL CONSEQUENCES
Dohmen, T., Falk, A., Huffman, D., Sunde, U., Schupp, J., & Wagner, G. G. (2011) · Journal of the European Economic Association · doi:10.1111/j.1542-4774.2011.01015.x · Cited by 3,896
Strong Evidence for Gender Differences in Risk Taking
Charness, G., & Gneezy, U. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.06.007 · Cited by 1,357
Feminist HCI: taking stock and outlining an agenda for design
Bardzell, S. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753521 · Cited by 1,123
An iterative design methodology for user-friendly natural language office information applications
Kelley, J. F. (1984) · ACM Transactions on Information Systems · doi:10.1145/357417.357420 · Cited by 702
Bias in algorithmic filtering and personalization
Bozdag, E. (2013) · Ethics and Information Technology · doi:10.1007/s10676-013-9321-6 · Cited by 649
Revisiting gender differences: what we know and what lies ahead.
Meyers‐Levy, J., & Loken, B. (2015) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2014.06.003 · Cited by 614
Storytelling alice motivates middle school girls to learn computer programming
Kelleher, C., Pausch, R., & Kiesler, S. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240844 · Cited by 505
Fairness testing: testing software for discrimination
Galhotra, S., Brun, Y., & Meliou, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106277 · Cited by 405 · cited 1×
“Also emerging are research methods to help detect such biases (e.g., [25, 56]).”
BackgroundState of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions
Mahatody, T., Sagar, M., & Kolski, C. (2010) · International Journal of Human–Computer Interaction · doi:10.1080/10447311003781409 · Cited by 335
GenderMag: A Method for Evaluating Software's Gender Inclusiveness
Burnett, M., Stumpf, S., Macbeth, J., Makri, S., Beckwith, L., Kwan, I., Peters, A., & Jernigan, W. (2016) · Interacting with Computers · doi:10.1093/iwc/iwv046 · Cited by 293
Self-citation
Research works printed but not linked: 18
- 10.4135/9781446221129.n6 · DOI · Paper page
- 10.1109/VLHCC.2007.15 · doi:10.1109/vlhcc.2007.15
- Adam Bradley, Cayley MacArthur, Mark Hancock, and Sheelagh Carpendale. 2015. Gendered or neutral? Considering the language of HCI. In Proceedings of the 41st Graphics Interface Conference (GI'15), 163--170.
- Margaret Burnett, Robin Counts, Ronette Lawrence, and Hannah Hanson. 2017. Gender HCI and Microsoft: Highlights from a longitudinal study. IEEE VLHCC, 139--143.
- Margaret Burnett, Simone Stumpf, Laura Beckwith, and Anicia Peters. 2018. The GenderMag Kit: How to Use the GenderMag Method to Find Inclusiveness Issues through a Gender Lens, http://gendermag.org, June 28, 2018.
- Judith Butler. 1999. Gender Trouble: Feminism and the Subversion of Identity. Routledge.
- Sally J. Cunningham, Annika Hinze, and David Nicols. 2016. "Supporting gender-neutral digital library creation A case study using the GenderMag Toolkit," Knowledge, Information, and Data in An Open Access Society, vol. 10075, pp. 45--50, 2016.
- FAT*, 2018. ACM Conference on Fairness, Accountability, and Transparency (ACM FAT*). Retrieved Sept. 11, 2018 from https://fatconference.org/
- IFIP News, 2018. ACM President Cherri Pancake Highlights Importance of Diversity in ICT, July 2018. Retrieved Sept. 11, 2018 from https://www.ifipnews.org/acm-president-cherri-pancakehighlights-importance-diversity-ict/
- 10.5555/2670296.2670301 · doi:10.5555/2670296.2670301
- Caitlin Kelleher. 2009. Barriers to programming engagement. Advances in Gender and Education 1, 1: 5- 10.
- 10.1145/2445196.2445202 · DOI · Paper page
- Jennifer Ann Rode. 2008. An ethnographic examination of the relationship of gender & end-user programming. Ph.D Thesis. University of California Irvine Irvine CA.
- René Riedl Marco Hubert and Peter Kenning. 2010. Are There Neural Gender Differences in Online Trust? An fMRI Study on the Perceived Trustworthiness of eBay Offers MIS Quarterly (34: 2) 397428. · doi:10.5555/2017458.2017469
- Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. In Data and Discrimination: Converting Critical Concerns into Productive Inquiry (a preconference at the 64th Annual Meeting of the International Communication Association).
- Lucy Suchman. Agencies in technology design: Feminist reconfigurations. In Proceedings of 5th European Symposium on Gender & ICT, Digital Cultures: Participation--Empowerment-- Diversity. 2009.
- Verdict. 2018. Ethics, GDPR, and diversity: Verdict talks to the president of the Association for Computing Machinery, July 2018. Retrieved Sept. 11, 2018 from https://www.verdict.co.uk/associationfor-computing-machinery-ethics/
- 10.5555/189200.189214 · doi:10.5555/189200.189214
Cited by
Balayn, A., Lofi, C., & Houben, G.-J. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00671-8 · Cited by 98
Break the Loop: Gender Imbalance in Music Recommenders
Ferraro, A., Serra, X., & Bauer, C. (2021) · Proceedings of the 2021 Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446033 · Cited by 92
“Studies have shown that the design of software [6, 7, 9, 50] or websites [33] may introduce bias for users of different genders.”
BackgroundKuttal, S. K., Ong, B., Kwasny, K., & Robe, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445659 · Cited by 44
What Needs Attention? Prioritizing Drivers of Developers' Trust and Adoption of Generative AI
Choudhuri, R., Trinkenreich, B., Pandita, R., Kalliamvakou, E., Steinmacher, I., Gerosa, M., Sanchez, C., & Sarma, A. (2025) · arXiv · doi:10.48550/arxiv.2505.17418 · Cited by 14
Kirks-Cler, D. N., Safford, S., & Marathe, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757680 · Cited by 4
“To remedy these harms, researchers have proposed inclusive design techniques to represent gender diverse people in individual systems [47, 48].”
Metadata
- Authors
- Vorvoreanu, M., Zhang, L., Huang, Y.-H., Hilderbrand, C., Steine-Hanson, Z., & Burnett, M.
- Affiliations
- Microsoft Research & Purdue University, Redmond, WA, USA
- Purdue University, West Lafayette, IN, USA
- Oregon State University, Corvallis, OR, USA
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-14
- Cited by
- 113
- References
- 45
- Funders
- NSF (1528061)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From Gender Biases to Gender-Inclusive Design: An Empirical Investigation. https://app.cochat.ai/papers/10.1145/3290605.3300283
- The paper
- Vorvoreanu, M., Zhang, L., Huang, Y.-H., Hilderbrand, C., Steine-Hanson, Z., & Burnett, M. (2019). From Gender Biases to Gender-Inclusive Design: An Empirical Investigation. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300283
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.