The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Gender bias in artificial intelligence: the need for diversity and gender theory in machine learning
Abstract
Artificial intelligence is increasingly influencing the opinions and behavior of people in everyday life. However, the over-representation of men in the design of these technologies could quietly undo decades of advances in gender equality. Over centuries, humans developed critical theory to inform decisions and avoid basing them solely on personal experience. However, machine intelligence learns primarily from observing data that it is presented with. While a machine's ability to process large volumes of data may address this in part, if that data is laden with stereotypical concepts of gender, the resulting application of the technology will perpetuate this bias. While some recent studies sought to remove bias from learned algorithms they largely ignore decades of research on how gender ideology is embedded in language. Awareness of this research and incorporating it into approaches to machine learning from text would help prevent the generation of biased algorithms. Leading thinkers in the emerging field addressing bias in artificial intelligence are also primarily female, suggesting that those who are potentially affected by bias are more likely to see, understand and attempt to resolve it. Gender balance in machine learning is therefore crucial to prevent algorithms from perpetuating gender ideologies that disadvantage women.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2018) · Cited by 3,510
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
Backhaus, W. (2016) · Klassiker der Sozialwissenschaften · doi:10.1007/978-3-658-13213-2_87 · Cited by 948
(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
Avoiding Discrimination through Causal Reasoning
Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., & Schölkopf, B. (2017) · arXiv · doi:10.48550/arxiv.1706.02744 · Cited by 358
The Construction of Beauty: A Cross-Cultural Analysis of Women's Magazine Advertising
Frith, K. (2005) · Journal of Communication · doi:10.1093/joc/55.1.56 · Cited by 298
Judith Butler, Gender Trouble: Feminism and the Subversion of Identity, (New York: Routledge, 1990)
Tacium, D. (1993) · Surfaces · doi:10.7202/1065107ar · Cited by 275
Reinventing Identities: The Gendered Self in Discourse
Bucholtz, M., Liang, A. C., & Sutton, L. A. (1999) · Cited by 225
Sex bias in language use: "Neutral" pronouns that aren't.
Moulton, J., Robinson, G. M., & Elias, C. S. (1978) · American Psychologist · doi:10.1037//0003-066x.33.11.1032 · Cited by 221
‘Curvy, hunky, kinky’: Using corpora as tools for critical analysis
Caldas-Coulthard, C. R., & Moon, R. (2010) · Discourse & Society · doi:10.1177/0957926509353843 · Cited by 174
Cited by
Schiavo, G., Businaro, S., & Zancanaro, M. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102537 · Cited by 284
AI pitfalls and what not to do: mitigating bias in AI
Gichoya, J. W., Thomas, K., Celi, L. A., Safdar, N., Banerjee, I., Banja, J. D., Seyyed-Kalantari, L., Trivedi, H., & Purkayastha, S. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20230023 · Cited by 277
Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers
Solanki, P., Grundy, J., & Hussain, W. (2023) · AI and Ethics · doi:10.1007/s43681-022-00195-z · Cited by 157
“To assist in thoughtful design, efforts should be made for the team developing and implementing AI to feature sociocultural diversity [159], including an appropriate representation of women [172], ensuring that the needs of these groups are not implicitly ignored by the AI initiative.”
BackgroundTowards trustworthy LLMs: a review on debiasing and dehallucinating in large language models
Lin, Z., Guan, S., Zhang, W., Zhang, H., Li, Y., & Zhang, H. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10896-y · Cited by 141
Balayn, A., Lofi, C., & Houben, G.-J. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00671-8 · Cited by 98
Metadata
- Authors
- Leavy, S.
- Venue
- Proceedings of the 1st International Workshop on Gender Equality in Software Engineering
- Publisher
- ACM
- Published
- 2018-05-28
- Pages
- 14-16
- OpenAlex
- W2810135932
- Cited by
- 284
- References
- 23
- FWCI
- 32.59
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gender bias in artificial intelligence: the need for diversity and gender theory in machine learning. https://app.cochat.ai/papers/10.1145/3195570.3195580
- The paper
- Leavy, S. (2018). Gender bias in artificial intelligence: the need for diversity and gender theory in machine learning. Proceedings of the 1st International Workshop on Gender Equality in Software Engineering. https://doi.org/10.1145/3195570.3195580
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.