The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index.
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Open accessAbstract
The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning and natural language processing tasks. We show that even word embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent. This raises concerns because their widespread use, as we describe, often tends to amplify these biases. Geometrically, gender bias is first shown to be captured by a direction in the word embedding. Second, gender neutral words are shown to be linearly separable from gender definition words in the word embedding. Using these properties, we provide a methodology for modifying an embedding to remove gender stereotypes, such as the association between between the words receptionist and female, while maintaining desired associations such as between the words queen and female. We define metrics to quantify both direct and indirect gender biases in embeddings, and develop algorithms to "debias" the embedding. Using crowd-worker evaluation as well as standard benchmarks, we empirically demonstrate that our algorithms significantly reduce gender bias in embeddings while preserving the its useful properties such as the ability to cluster related concepts and to solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“'Clean' text additionally has been misrepresented as being 'unbiased' against any community-a notion that has been strongly contested [22, 73, 130].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“temporality has been flagged as a potential source of difficulty in textual data, where models trained on historical text corpora, such as Google News articles, have been found to reproduce past social stereotypes (e.g. the word”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generative AI outputs tend to reproduce normative views and mirror societal biases for marginalized groups [15, 21, 36, 41, 42, 45, 53, 66, 72, 91], including PwD [10, 12, 39, 48, 54, 62, 77, 113].”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“natural language processing (NLP) algorithms for textual analysis can display recurrent gender biases (Bolukbasi et al. 2016), for instance, associating the word “doctor” with “father” and “nurse” with “mother””
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Bolukbasi et al. 2016
The cited source says what the claim attributes to it.
In the citing paper
“Some solutions even allow for the dataset to remain unchanged while the ML algorithm is tuned to produce more robust or socially equitable outcomes [14,29].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“The seminal works of Bolukbasi et al. (2016) and Caliskan et al. (2017) show that word embeddings such as word2vec (Mikolov et al., 2013) and GloVe (Pennington et al., 2014) contain stereotypical biases using diagnostic methods like word analogies and association tests.”
From StereoSet: Measuring stereotypical bias in pretrained language models (2021) · cites this paper as Bolukbasi et al. (2016)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,529
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Research works printed but not linked: 7
- [5][5] A. J. Cuddy, E. B. Wolf, P. Glick, S. Crotty, J. Chong, and M. I. Norton. Men as cultural ideals: Cultural values moderate gender stereotype content. Journal of personality and social psychology , 109(4):622, 2015. -
- [6][6] A. Datta, M. C. Tschantz, and A. Datta. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies , 2015. -
- [11][11] C. Fellbaum, editor. Wordnet: An Electronic Lexical Database . The MIT Press, Cambridge, MA, 1998. -
- [13][13] P. Glick and S. T. Fiske. The ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of personality and social psychology , 70(3):491, 1996. -
- [16][16] C. Hansen, M. Tosik, G. Goossen, C. Li, L. Bayeva, F. Berbain, and M. Rotaru. How to get the best word vectors for resume parsing. In SNN Adaptive Intelligence / Symposium: Machine Learning 2015, Nijmegen. -
- [20][20] J. T. Jost and A. C. Kay. Exposure to benevolent sexism and complementary gender stereotypes: consequences for specific and diffuse forms of system justification. Journal of personality and social psychology , 88(3):498, 2005. -
- [35][35] J. P. Stanley. Paradigmatic woman: The prostitute. Papers in language variation , pages 303-321, 1977. -
Cited by
Sorted by citations
Items 801–900 of 1,022
Semi-Supervised Topic Modeling for Gender Bias Discovery in English and Swedish
Devinney, H., Björklund, J., & Björklund, H. (2020) · DiVA at Umeå University (Umeå University) · Cited by 12
Schneider, N., Sohrabi, K., Schneider, H., Zimmer, K., Fischer, P., de Laffolie, J., & CEDATA-GPGE Study Group (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.666190 · Cited by 13
Probing Word Syntactic Representations in the Brain by a Feature Elimination Method
Zhang, X., Wang, S., Lin, N., Zhang, J., & Zong, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21427 · Cited by 14
On measuring and mitigating biased inferences of word embeddings
Dev, S., Li, T., Phillips, J. M., & Srikumar, V. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6267 · Cited by 14
Argument from Old Man's View: Assessing Social Bias in ArgumentationPreprint
Spliethöver, M., & Wachsmuth, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12014 · Cited by 12
Fear and Loathing: ChatGPT in the Political Science Classroom
Ardoin, P., & Hicks, W. D. (2024) · PS Political Science & Politics · doi:10.1017/s1049096524000131 · Cited by 10
Algorithmic Issues, Challenges, and Theoretical Concerns of ChatGPT
Patil, P., Kulkarni, K., & Sharma, P. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-6824-4.ch003 · Cited by 11
Contrastive adversarial gender debiasing
Torres, N. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100092 · Cited by 11
Evaluating Synthetic Data Generation from User Generated Text
Chim, J., Ive, J., & Liakata, M. (2024) · Computational Linguistics · doi:10.1162/coli_a_00540 · Cited by 12
A workshop on artificial intelligence biases and its effect on high school students’ perceptions
Gómez, M. J., Dabbah, J., & Benotti, L. (2024) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2024.100710 · Cited by 10
Designing an AI-Supported Framework for Literary Text Adaptation in Primary Classrooms
Chatzichristofis, S. A., Tsopozidis, A., Kyriakidou-Zacharoudiou, A., Evripidou, S., & Amanatiadis, A. A. (2025) · AI · doi:10.3390/ai6070150 · Cited by 15
Embedding Words in Non-Vector Space with Unsupervised Graph Learning
Ryabinin, M., Popov, S., Prokhorenkova, L., & Voita, E. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.594 · Cited by 10
Measuring Societal Biases from Text Corpora with Smoothed First-Order Co-occurrence
Rekabsaz, N., West, R., Henderson, J., & Hanbury, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18083 · Cited by 12
Understanding User Sensemaking in Machine Learning Fairness Assessment Systems
Gu, Z., Yan, J. N., & Rzeszotarski, J. M. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450092 · Cited by 15
Towards Equal Gender Representation in the Annotations of Toxic Language Detection
Excell, E., & Moubayed, N. A. (2021) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2021.gebnlp-1.7 · Cited by 13
Heidenreich, H. S., & Williams, J. R. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462578 · Cited by 11
Implicit Bias Reflects the Company That Words Keep
Hauser, D. J., & Schwarz, N. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.871221 · Cited by 7
Intersectional Inquiry, on the Ground and in the Algorithm
Robertson, S., Magee, L., & Soldatić, K. (2022) · Qualitative Inquiry · doi:10.1177/10778004221099560 · Cited by 14
Elad, V. M., Anton, T., Ganios, N. C., & Rebecca, V. W. (2023) · Pigment Cell & Melanoma Research · doi:10.1111/pcmr.13090 · Cited by 10
AŞKUN, V. (2023) · Erciyes Akademi · doi:10.48070/erciyesakademi.1281544 · Cited by 13
Identifying Biases in Politically Biased Wikis through Word Embeddings
Knoche, M., Popović, R., Lemmerich, F., & Strohmaier, M. (2019) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3342220.3343658 · Cited by 10
Clouded reality: News representations of culturally close and distant ethnic outgroups
Kroon, A. C., Trilling, D., van der Meer, T. G. L. A., & Jonkman, J. G. F. (2019) · Communications · doi:10.1515/commun-2019-2069 · Cited by 10
Towards Understanding the Instability of Network Embedding
Wang, C., Rao, W., Guo, W., Wang, P., Liu, J., & Guan, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2989512 · Cited by 10
comp-syn: Perceptually Grounded Word Embeddings with Color
Desikan, B. S., Hull, T., Nadler, E. O., Guilbeault, D., Kar, A. A., Chu, M., & Sardo, D. R. L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.154 · Cited by 13
Multi-objective multi-fidelity hyperparameter optimization with application to fairness
Schmucker, R., Donini, M., Perrone, V., & Archambeau, C. (2020) · Cited by 10
Interrater disagreement resolution: A systematic procedure to reach consensus in annotation tasks
Oortwijn, Y., Ossenkoppele, T., & Betti, A. (2021) · UvA-DARE (University of Amsterdam) · Cited by 10
All Roads Lead to Polenta: Cultural Attractors at the Junction of Public and Personal Culture
Boutyline, A., Cornell, D., & Arseniev‐Koehler, A. (2021) · Sociological Forum · doi:10.1111/socf.12760 · Cited by 10
Can We Improve Model Robustness through Secondary Attribute Counterfactuals?
Balashankar, A., Wang, X., Packer, B., Thain, N., Ed, H., & Beutel, A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.386 · Cited by 11
Measuring Gender Bias in Contextualized Embeddings
Katsarou, S., Rodríguez-Gálvez, B., & Shanahan, J. (2022) · doi:10.3390/cmsf2022003003 · Cited by 11
How do the kids speak? Improving educational use of text mining with child-directed language models
Organisciak, P., Newman, M., Eby, D., Acar, S., & Dumas, D. (2023) · Information and Learning Sciences · doi:10.1108/ils-06-2022-0082 · Cited by 14
AI Fairness via Domain AdaptationPreprint
Joshi, N., & Burlina, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01109 · Cited by 10
Investigating Failures of Automatic Translation in the Case of Unambiguous GenderPreprint
Renduchintala, A., & Williams, A. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2104.07838 · Cited by 28
Improving Gender Translation Accuracy with Filtered Self-TrainingPreprint
Choubey, P. K., Currey, A., Mathur, P., & Dinu, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07695 · Cited by 10
Beyond the hype: large language models propagate race-based medicinePreprint
Omiye, J. A., Lester, J., Spichak, S., Rotemberg, V. M., & Daneshjou, R. (2023) · medRxiv · doi:10.1101/2023.07.03.23292192 · Cited by 10
The Augmented Qualitative Researcher: Using Generative AI in Qualitative Text AnalysisPreprint
Ibrahim, E. I., & Voyer, A. M. (2024) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/gkc8w · Cited by 15
Discovering and Mitigating Biases in CLIP-based Image Editing
Tanjim, M. M., Singh, K. K., Kafle, K., Sinha, R., & Cottrell, G. W. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00296 · Cited by 11
Luo, J., Cherry, C., & Foster, G. F. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00645 · Cited by 18
Intersectional biases in narratives produced by open-ended prompting of generative language models
Shieh, E., Vassel, F.-M., Sugimoto, C. R., & Monroe‐White, T. (2026) · Nature Communications · doi:10.1038/s41467-025-68004-9 · Cited by 21
Larsson, S., White, J. M., & Bogusz, C. I. (2024) · Social Inclusion · doi:10.17645/si.7471 · Cited by 23
HarmonyNet: Navigating hate speech detection
Raza, S., & Chatrath, V. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100098 · Cited by 11
Inclusive Prompt Engineering: A Methodology for Hacking Biased AI Image Generation
Skilton, R., & Cardinal, A. (2024) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/3641237.3691655 · Cited by 9
Epistemic injustices and curriculum: Strategizing for justice
Babu, Y. S., Mishra, P., Kumar, A., Pandey, C. S., & Pandey, S. (2024) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2024.101220 · Cited by 13
Biases in GPT-3.5 Turbo model: a case study regarding gender and language
Assi, F. M., & Caseli, H. D. M. (2024) · Simpósio Brasileiro de Tecnologia da Informação e da Linguagem Humana (STIL) · doi:10.5753/stil.2024.245358 · Cited by 9
Exploring the Future of Corpus Linguistics: Innovations in AI and Social Impact
Incelli, E. (2025) · International journal of mass communication. · doi:10.6000/2818-3401.2025.03.01 · Cited by 13
Privacy Enhanced Multimodal Neural Representations for Emotion Recognition
Jaiswal, M., & Mower Provost, E. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i05.6307 · Cited by 63
Measuring Biases of Word Embeddings: What Similarity Measures and Descriptive Statistics to Use?
Azarpanah, H., & Farhadloo, M. (2021) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2021.trustnlp-1.2 · Cited by 9
Language patterns of outgroup prejudice
Li, Y., & Hills, T. T. (2021) · Cognition · doi:10.1016/j.cognition.2021.104813 · Cited by 9
Latent Space Smoothing for Individually Fair Representations
Peychev, M., Ruoss, A., Balunović, M., Baader, M., & Vechev, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19778-9_31 · Cited by 11
Shu, L., Pandit, S., Tritsch, T., Levy, A., & Shoja, M. M. (2024) · Cureus · doi:10.7759/cureus.54448 · Cited by 13
Empowering the Metaverse in Education: ChatGPT’s Role in Transforming Learning Experiences
Alfaisal, R., Hashim, H., & Azizan, U. H. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-65996-6_2 · Cited by 10
Distributional Effects of Gender Contrasts Across Categories
Mickus, T., Bonami, O., & Paperno, D. (2019) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/g11b-3s25 · Cited by 9
Tracking and Improving Information in the Service of Fairness
Garg, S., Kim, M. P., & Reingold, O. (2019) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3328526.3329624 · Cited by 11
Media Bias Characterization in Brazilian Presidential Elections
Sales, A., Marinho, L. B., & Veloso, A. (2019) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3342220.3343656 · Cited by 9
Joint Multiclass Debiasing of Word Embeddings
Popović, R., Lemmerich, F., & Strohmaier, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59491-6_8 · Cited by 9
Dialect Diversity in Text Summarization on Twitter
Keswani, V., & Celis, L. E. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450108 · Cited by 13
Debiasing Multilingual Word Embeddings: A Case Study of Three Indian Languages
Bansal, S., Garimella, V., Suhane, A., & Mukherjee, A. (2021) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3465336.3475118 · Cited by 9
Understanding Social Biases Behind Location Names in Contextual Word Embedding Models
Wu, F., Du, M., Fan, C. H., Tang, R., Yang, Y., Mostafavi, A., & Hu, X. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3106003 · Cited by 9
Feature and Label Embedding Spaces Matter in Addressing Image Classifier Bias
Thong, W. E., & Snoek, C. G. M. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.46 · Cited by 9
Understanding the effects of negative (and positive) pointwise mutual information on word vectors
Salle, A., & Villavicencio, A. (2022) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2022.2072004 · Cited by 11
A study of bias mitigation strategies for speaker recognition
Peri, R., Somandepalli, K., & Narayanan, S. S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101481 · Cited by 17
The Sins of the Parents Are to Be Laid Upon the Children: Biased Humans, Biased Data, Biased Models
Osborne, M. R., Omrani, A., & Dehghani, M. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231180099 · Cited by 9
Inducing a lexicon of sociolinguistic variables from code-mixed text
Shoemark, P., Kirby, J., & Goldwater, S. J. (2018) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/w18-6101 · Cited by 9
Statistical learning from biased training samples
Clémençon, S., & Laforgue, P. (2022) · Electronic Journal of Statistics · doi:10.1214/22-ejs2084 · Cited by 10
DFPE: Explaining Predictive Models for Disk Failure Prediction
Xie, Y., Feng, D., Wang, F., Tang, X., Han, J., & Zhang, X. (2019) · Digest of papers - IEEE Symposium on Mass Storage Systems · doi:10.1109/msst.2019.000-3 · Cited by 9
Debiasing representations by removing unwanted variation due to protected attributesPreprint
Bower, A., Niss, L., Sun, Y., & Vargo, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00461 · Cited by 9
What Are You Hiding? Algorithmic Transparency and User Perceptions
Springer, A., & Whittaker, S. (2018) · arXiv · doi:10.48550/arxiv.1812.03220 · Cited by 9
Integrating Artificial Intelligence into Weapon SystemsPreprint
Feldman, P., Dant, A., & Massey, A. K. (2019) · arXiv (Cornell University) · doi:10.13016/m2dwgg-rsif · Cited by 9
Fairness and Missing ValuesPreprint
Martínez‐Plumed, F., Ferri, C., Nieves, D., & Hernández‐Orallo, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12728 · Cited by 9
The Woman Worked as a Babysitter: On Biases in Language GenerationPreprint
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.01326 · Cited by 9
Self-citationTo Transfer or Not to Transfer: Misclassification Attacks Against Transfer Learned Text ClassifiersPreprint
Pal, B., & Tople, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.02438 · Cited by 10
Fairness through Experimentation: Inequality in A/B testing as an approach to responsible designPreprint
Saint-Jacques, G., Sepehri, A. A., Li, N., & Perišić, I. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2002.05819 · Cited by 9
Towards Ethics by Design in Online Abusive Content DetectionPreprint
Kiritchenko, S., & Nejadgholi, I. (2020) · arXiv (Cornell University) · doi:10.4224/40002027 · Cited by 15
Minot, J. R., Cheney, N., Maier, M. E., Elbers, D. C., Danforth, C. M., & Dodds, P. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05841 · Cited by 9
Balancing out Bias: Achieving Fairness Through Training Reweighting.Preprint
Han, X., Baldwin, T., & Cohn, T. (2021) · arXiv (Cornell University) · Cited by 9
GeDi: Generative Discriminator Guided Sequence GenerationPreprint
Krause, B., Gotmare, A. D., McCann, B., Keskar, N. S., Joty, S., Socher, R., & Rajani, N. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.06367 · Cited by 164
Population-based Ensemble Learning with Tree Structures for Classification
Evans, B. (2019) · doi:10.26686/wgtn.17136296 · Cited by 8
Bayesian nonparametric mixture modeling for temporal dynamics of gender stereotypes
Iorio, M. D., Favaro, S., Guglielmi, A., & Ye, L. (2023) · The Annals of Applied Statistics · doi:10.1214/22-aoas1717 · Cited by 8
Antonopoulou, C. (2023) · Technoetic Arts · doi:10.1386/tear_00109_1 · Cited by 9
Jung, J., Zhou, W., & Smith, A. D. (2024) · Organizational Research Methods · doi:10.1177/10944281241228186 · Cited by 8
Unraveling the Inner Workings of Massive Language Models
Babu, C. V. S., Anniyappa, C. S. A., & Dharma Sastha, B. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-3860-5.ch008 · Cited by 8
Detecting and Mitigating Bias in LLMs through Knowledge Graph-Augmented Training
Kumar, R., Kumar, H., & Shalini, K. (2025) · International Conference on Artificial Intelligence and Data Engineering (AIDE) · doi:10.1109/aide64228.2025.10987418 · Cited by 8
Algorithmic Fairness in Automatic Short Answer Scoring
Andersen, N., Mang, J., Goldhammer, F., & Zehner, F. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00495-5 · Cited by 17
Discovering Stylistic Variations in Distributional Vector Space Models via Lexical Paraphrases
Niu, X., & Carpuat, M. J. (2017) · doi:10.18653/v1/w17-4903 · Cited by 8
A benchmark for evaluating Arabic word embedding models
Yagi, S., Elnagar, A., & Fareh, S. I. (2022) · Natural Language Engineering · doi:10.1017/s1351324922000444 · Cited by 8
Ignoring the alternatives: The N400 is sensitive to stimulus preactivation alone
Michaelov, J. A., & Bergen, B. K. (2023) · Cortex · doi:10.1016/j.cortex.2023.08.001 · Cited by 9
Owino, B. A., & Paschal, M. J. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0205-7.ch011 · Cited by 8
Automating Bias Testing of LLMs
Morales, S., Clarisó, R., & Cabot, J. (2023) · International Conference on Automated Software Engineering · doi:10.1109/ase56229.2023.00018 · Cited by 6
A Comparative Study of Different Dimensionality Reduction Techniques for Arabic Machine Translation
Bensalah, N., Ayad, H., Adib, A., & Farouk, A. I. E. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3634681 · Cited by 8
Gronowski, A. A., Paul, W., Alajaji, F., Gharesifard, B., & Burlina, P. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3340094 · Cited by 10
Kaplan, D. M., Tidwell, C. A., Chung, J. M., Alisic, E., Demiray, B., Bruni, M. R., Evora, S., Gajewski‐Nemes, J. A., Macbeth, A., Mangelsdorf, S. N., et al. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02293-0 · Cited by 9
A Tool Kit for Relation Induction in Text Analysis
Stoltz, D. S., Taylor, M. A., & Dudley, J. S. K. (2024) · Sociological Methods & Research · doi:10.1177/00491241241233242 · Cited by 8
Causal inference for social discrimination reasoning
Qureshi, B., Kamiran, F., Karim, A., Ruggieri, S., & Pedreschi, D. (2019) · Journal of Intelligent Information Systems · doi:10.1007/s10844-019-00580-x · Cited by 27
Going Beyond T-SNE: Exposing whatlies in Text Embeddings
Warmerdam, V. D., Kober, T., & Tatman, R. (2020) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/2020.nlposs-1.8 · Cited by 9
Environmental Adaptation and Differential Replication in Machine Learning
Unceta, I., Nin, J., & Pujol, O. (2020) · Entropy · doi:10.3390/e22101122 · Cited by 9
Kurpicz-Briki, M., & Leoni, T. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.625290 · Cited by 10
GFST: Gender-Filtered Self-Training for More Accurate Gender in Translation
Choubey, P. K., Currey, A., Mathur, P., & Dinu, G. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.123 · Cited by 21
Speciesist language and nonhuman animal bias in English Masked Language Models
Takeshita, M., Rzepka, R., & Araki, K. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103050 · Cited by 10
Bias Mitigation for Toxicity Detection via Sequential Decisions
Cheng, L., Mosallanezhad, A., Silva, Y. N., Hall, D. L., & Liu, H. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531945 · Cited by 8
Towards solving NLP tasks with optimal transport loss
Bhardwaj, R., Vaidya, T. S., & Poria, S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.10.031 · Cited by 9
Word embedding for social sciences: an interdisciplinary survey
Matsui, A., & Ferrara, E. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2562 · Cited by 9
Metadata
- Authors
- Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A.
- Affiliations
- Boston University (US)
- Microsoft Research New England (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1607.06520
- OpenAlex
- W2483215953
- Cited by
- 1,615
- References
- 33
- Citations by year
- 2026: 17 · 2025: 136 · 2024: 201 · 2023: 240 · 2022: 154 · 2021: 313 · 2020: 253 · 2019: 204 · 2018: 69 · 2017: 26 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- OpenBU (Boston University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- gender bias, word embeddings, bias mitigation, gender stereotypes, gender neutrality, analogy tasks, concept clustering, Google News, crowdsourced evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
