Assessing Gender Bias in Machine Translation -- A Case Study with Google Translate
Open accessAbstract
Recently there has been a growing concern about machine bias, where trained statistical models grow to reflect controversial societal asymmetries, such as gender or racial bias. A significant number of AI tools have recently been suggested to be harmfully biased towards some minority, with reports of racist criminal behavior predictors, Iphone X failing to differentiate between two Asian people and Google photos' mistakenly classifying black people as gorillas. Although a systematic study of such biases can be difficult, we believe that automated translation tools can be exploited through gender neutral languages to yield a window into the phenomenon of gender bias in AI. In this paper, we start with a comprehensive list of job positions from the U.S. Bureau of Labor Statistics (BLS) and used it to build sentences in constructions like "He/She is an Engineer" in 12 different gender neutral languages such as Hungarian, Chinese, Yoruba, and several others. We translate these sentences into English using the Google Translate API, and collect statistics about the frequency of female, male and gender-neutral pronouns in the translated output. We show that GT exhibits a strong tendency towards male defaults, in particular for fields linked to unbalanced gender distribution such as STEM jobs. We ran these statistics against BLS' data for the frequency of female participation in each job position, showing that GT fails to reproduce a real-world distribution of female workers. We provide experimental evidence that even if one does not expect in principle a 50:50 pronominal gender distribution, GT yields male defaults much more frequently than what would be expected from demographic data alone. We are hopeful that this work will ignite a debate about the need to augment current statistical translation tools with debiasing techniques which can already be found in the scientific literature.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Male defaults are not only prominent but exaggerated in fields suggested to be troubled with gender stereotypes, such as STEM jobs.
““male defaults are not only prominent but exaggerated in fields suggested to be troubled with gender stereotypes, such as STEM (Science, Technology, Engineering and Mathematics) jobs.””
From Discrimination, artificial intelligence, and algorithmic decision-making (2025) · cites this paper as Prates, Avelar and Lamb 2018
Google Translate exhibits a strong tendency towards male defaults.
“The authors concluded that Google Translate “exhibits a strong tendency towards male defaults”.”
From Discrimination, artificial intelligence, and algorithmic decision-making (2025) · cites this paper as Prates, Avelar and Lamb 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Wang, Y., & Kosinski, M. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000098 · Cited by 766 · cited 1× · see citing works
“ectly revived heated debates about the controversial eld of physiognomy, with proposals of AI systems capable of identifying the sexual orientation of an individual through its facial characteristics [38]. Similar concerns are growing at an unprecedented rate in the media, with reports of Apple’s Iphone X face unlock…”
BackgroundGarcia, M. (2016) · World Policy Journal · doi:10.1215/07402775-3813015 · Cited by 257 · cited 2× · see citing works
“risome results in machine learning have somewhat supported Schiebinger’s view. Not only Google photos’ statistical image labeling algorithm has been found to classify dark-skinned people as gorillas (Garcia, 2016) and purportedly intelligent programs have been suggested to be negatively biased against black prisoners…”
Background
Flagged first, then by citations
Research works printed but not linked: 21
- [2][2] Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. CoRR abs/1409.0473 (2014). URL http://arxiv.org/abs/ 1409.0473 - · arXiv
- [4][4] Boitet, C., Blanchon, H., Seligman, M., Bellynck, V.: Mt on and for the web. In: Natural Language Processing and Knowledge Engineering (NLP-KE), 2010 International Conference on, pp. 1-10. IEEE (2010) -
- [5][5] Bolukbasi, T., Chang, K.W., Zou, J.Y., Saligrama, V., Kalai, A.T.: Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In: Advances in Neural Information Processing Systems, pp. 4349-4357 (2016) -
- [6][6] Boroditsky, L., Schmidt, L.A., Phillips, W.: Sex, syntax, and semantics. Language in mind: Advances in the study of language and thought pp. 61-79 (2003) -
- [8][8] Carl, M., Way, A.: Recent advances in example-based machine translation, vol. 21. Springer Science & Business Media (2003) -
- [9][9] Chomsky, N.: The golden age: A look at the original roots of artificial intelligence, cognitive science, and neuroscience (partial transcript of an interview with N. Chomsky at MIT150 Symposia: Brains, minds and machines symposium (2011). URL https: //chomsky.info/20110616/ . Last visited 2017-12-26 -
- [11][11] Dascal, M.: Universal language schemes in England and France, 1600-1800 comments on James Knowlson. Studia leibnitiana 14 (1), 98-109 (1982) -
- [13][13] Dryer, M.S., Haspelmath, M. (eds.): WALS Online. Max Planck Institute for Evolutionary Anthropology, Leipzig (2013). URL http://wals.info/ -
- [14][14] Firat, O., Cho, K., Sankaran, B., Yarman-Vural, F.T., Bengio, Y.: Multi-way, multilingual neural machine translation. Computer Speech & Language 45 , 236-252 (2017). DOI 10.1016/j.csl.2016.10.006. URL https://doi.org/10.1016/j.csl.2016.10.006 - · DOI
- [17][17] Gordin, M.D.: Scientific Babel: How science was done before and after global English. University of Chicago Press (2015) -
- [18][18] Hajian, S., Bonchi, F., Castillo, C.: Algorithmic bias: From discrimination discovery to fairness-aware data mining. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 2125-2126. ACM (2016) -
- [20][20] Johnson, M., Schuster, M., Le, Q.V., Krikun, M., Wu, Y., Chen, Z., Thorat, N., Vi´ egas, F.B., Wattenberg, M., Corrado, G., Hughes, M., Dean, J.: Google's multilingual neural machine translation system: Enabling zero-shot translation. TACL 5 , 339-351 (2017). URL https://transacl.org/ojs/index.php/tacl/article/view/1081 -
- [21][21] Kay, P., Kempton, W.: What is the sapir-whorf hypothesis? American anthropologist 86 (1), 65-79 (1984) -
- [23][23] Kirkpatrick, K.: Battling algorithmic bias: how do we ensure algorithms treat us fairly? Communications of the ACM 59 (10), 16-17 (2016) -
- [25][25] Koehn, P.: Statistical machine translation. Cambridge University Press (2009) -
- [26][26] Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E.: Moses: Open source toolkit for statistical machine translation. In: - ACL 2007, Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, June 23-30, 2007, Prague, Czech Republic (2007). URL http://aclweb.org/anthology/P07-2045 -
- [27][27] Locke, W.N., Booth, A.D.: Machine translation of languages: fourteen essays. Published jointly by Technology Press of the Massachusetts Institute of Technology and Wiley, New York (1955) -
- [29][29] Moss-Racusin, C.A., Molenda, A.K., Cramer, C.R.: Can evidence impact attitudes? public reactions to evidence of gender bias in stem fields. Psychology of Women Quarterly 39 (2), 194-209 (2015) -
- [34][34] Santacreu-Vasut, E., Shoham, A., Gay, V.: Do female/male distinctions in language matter? Evidence from gender political quotas. Applied Economics Letters 20 (5), 495-498 (2013) -
- [35][35] Schiebinger, L.: Scientific research must take gender into account. Nature 507 (7490), 9 (2014) -
- [39][39] Weaver, W.: Translation. In: W.N. Locke, A.D. Booth (eds.) Machine translation of languages, vol. 14, pp. 15-23. Cambridge: Technology Press, MIT (1955). URL http://www.mt-archive.info/Weaver-1949.pdf . Last visited 2017-12-17 -
Cited by
Sorted by citations
Discrimination, artificial intelligence, and algorithmic decision-making
Borgesius, F. Z. (2025) · arXiv · doi:10.48550/arxiv.2510.13465 · Cited by 152 · see citing works
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization
Ladhak, F., Durmus, E., Suzgun, M., Zhang, T., Jurafsky, D., McKeown, K., & Hashimoto, T. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.234 · Cited by 30 · see citing works
- Authors
- Prates, M. O. R., Avelar, P. H. C., & Lamb, L.
- Affiliations
- Universidade Federal do Rio Grande do Sul (BR)
- Corresponding author
- Prates, Marcelo O. R.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 32
- Issue
- 10
- Pages
- 6363-6381
- ISSN
- 0941-0643 (ISSN-L)
- arXiv
- 1809.02208
- OpenAlex
- W2891525068
- Cited by
- 409
- References
- 2
- Citations by year
- 2026: 37 · 2025: 57 · 2024: 48 · 2023: 101 · 2022: 62 · 2021: 60 · 2020: 27 · 2019: 17
- FWCI
- 72.51
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Neural Computing and Applications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Social Sciences › Gender Studies › Gender Studies in Language
- Keywords
- gender bias, machine translation, Google Translate, gender-neutral language, bias mitigation, gender stereotypes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
