The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index.
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Open accessAbstract
The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning and natural language processing tasks. We show that even word embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent. This raises concerns because their widespread use, as we describe, often tends to amplify these biases. Geometrically, gender bias is first shown to be captured by a direction in the word embedding. Second, gender neutral words are shown to be linearly separable from gender definition words in the word embedding. Using these properties, we provide a methodology for modifying an embedding to remove gender stereotypes, such as the association between between the words receptionist and female, while maintaining desired associations such as between the words queen and female. We define metrics to quantify both direct and indirect gender biases in embeddings, and develop algorithms to "debias" the embedding. Using crowd-worker evaluation as well as standard benchmarks, we empirically demonstrate that our algorithms significantly reduce gender bias in embeddings while preserving the its useful properties such as the ability to cluster related concepts and to solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“'Clean' text additionally has been misrepresented as being 'unbiased' against any community-a notion that has been strongly contested [22, 73, 130].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“temporality has been flagged as a potential source of difficulty in textual data, where models trained on historical text corpora, such as Google News articles, have been found to reproduce past social stereotypes (e.g. the word”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generative AI outputs tend to reproduce normative views and mirror societal biases for marginalized groups [15, 21, 36, 41, 42, 45, 53, 66, 72, 91], including PwD [10, 12, 39, 48, 54, 62, 77, 113].”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“natural language processing (NLP) algorithms for textual analysis can display recurrent gender biases (Bolukbasi et al. 2016), for instance, associating the word “doctor” with “father” and “nurse” with “mother””
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Bolukbasi et al. 2016
The cited source says what the claim attributes to it.
In the citing paper
“Some solutions even allow for the dataset to remain unchanged while the ML algorithm is tuned to produce more robust or socially equitable outcomes [14,29].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“The seminal works of Bolukbasi et al. (2016) and Caliskan et al. (2017) show that word embeddings such as word2vec (Mikolov et al., 2013) and GloVe (Pennington et al., 2014) contain stereotypical biases using diagnostic methods like word analogies and association tests.”
From StereoSet: Measuring stereotypical bias in pretrained language models (2021) · cites this paper as Bolukbasi et al. (2016)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,529
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Research works printed but not linked: 7
- [5][5] A. J. Cuddy, E. B. Wolf, P. Glick, S. Crotty, J. Chong, and M. I. Norton. Men as cultural ideals: Cultural values moderate gender stereotype content. Journal of personality and social psychology , 109(4):622, 2015. -
- [6][6] A. Datta, M. C. Tschantz, and A. Datta. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies , 2015. -
- [11][11] C. Fellbaum, editor. Wordnet: An Electronic Lexical Database . The MIT Press, Cambridge, MA, 1998. -
- [13][13] P. Glick and S. T. Fiske. The ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of personality and social psychology , 70(3):491, 1996. -
- [16][16] C. Hansen, M. Tosik, G. Goossen, C. Li, L. Bayeva, F. Berbain, and M. Rotaru. How to get the best word vectors for resume parsing. In SNN Adaptive Intelligence / Symposium: Machine Learning 2015, Nijmegen. -
- [20][20] J. T. Jost and A. C. Kay. Exposure to benevolent sexism and complementary gender stereotypes: consequences for specific and diffuse forms of system justification. Journal of personality and social psychology , 88(3):498, 2005. -
- [35][35] J. P. Stanley. Paradigmatic woman: The prostitute. Papers in language variation , pages 303-321, 1977. -
Cited by
Sorted by citations
Items 101–200 of 1,022
Refining Word Embeddings Using Intensity Scores for Sentiment Analysis
Yu, L.-C., Wang, J., Lai, K.-H. R., & Zhang, X. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2788182 · Cited by 177
Al-Sharafi, M. A., Al‐Emran, M., Arpacı, İ., Iahad, N. A., AlQudah, A. A., Iranmanesh, M., & Al-Qaysi, N. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107708 · Cited by 204
Jha, A., & Mamidi, R. (2017) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/w17-2902 · Cited by 178
Word Embeddings: What Works, What Doesn’t, and How to Tell the Difference for Applied Research
Rodriguez, P. L., & Spirling, A. (2022) · The Journal of Politics · doi:10.1086/715162 · Cited by 254
Gender Bias in Machine Translation
Savoldi, B., Gaido, M., Bentivogli, L., Negri, M., & Turchi, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00401 · Cited by 229
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
Steed, R., & Caliskan, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445932 · Cited by 189
Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual
He, H., Zha, S., & Wang, H. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6115 · Cited by 178
Gonen, H., & Goldberg, Y. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1061 · Cited by 454
Automatically Neutralizing Subjective Bias in Text
Pryzant, R., Martinez, R. D., Dass, N., Kurohashi, S., Jurafsky, D., & Yang, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5385 · Cited by 171
Towards Debiasing Sentence Representations
Liang, P. P., Li, I., Zheng, E., Lim, Y. C., Salakhutdinov, R., & Morency, L. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.488 · Cited by 188
AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications
Chen, P., Wu, L., & Wang, L. (2023) · Applied Sciences · doi:10.3390/app131810258 · Cited by 155
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation
Dinan, E., Fan, A., Williams, A., Urbanek, J., Kiela, D., & Weston, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.656 · Cited by 190
On the road to explainable AI in drug-drug interactions prediction: A systematic review
Vo, T. H., Nguyen, N. T. K., Kha, Q. H., & Le, N. Q. K. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.04.021 · Cited by 162
Chen, N.-C., Drouhard, M., Kocielnik, R., Suh, J., & Aragon, C. R. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3185515 · Cited by 152
Lukacik, E., Bourdage, J. S., & Roulin, N. (2020) · Human Resource Management Review · doi:10.1016/j.hrmr.2020.100789 · Cited by 182
Ethical and legal challenges of AI in marketing: an exploration of solutions
Kumar, D., & Suthar, N. (2024) · Journal of Information, Communication and Ethics in Society · doi:10.1108/jices-05-2023-0068 · Cited by 180
Patterns of Implicit and Explicit Stereotypes III: Long-Term Change in Gender Stereotypes
Charlesworth, T. E. S., & Banaji, M. R. (2021) · Social Psychological and Personality Science · doi:10.1177/1948550620988425 · Cited by 185
Implicit-Bias Remedies: Treating Discriminatory Bias as a Public-Health Problem
Greenwald, A. G., Dasgupta, N., Dovidio, J. F., Kang, J., Moss‐Racusin, C. A., & Teachman, B. A. (2022) · Gothic.net · doi:10.1177/15291006211070781 · Cited by 176
Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings
Bommasani, R., Davis, K., & Cardie, C. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.431 · Cited by 163
Should You Fine-Tune BERT for Automated Essay Scoring?
Mayfield, E., & Black, A. W. (2020) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2020.bea-1.15 · Cited by 155
Sun, L., Wei, M., Sun, Y., Suh, Y. J., Shen, L., & Yang, S. (2023) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmad045 · Cited by 146
Quantifying social organization and political polarization in online platforms
Waller, I., & Anderson, A. (2021) · Nature · doi:10.1038/s41586-021-04167-x · Cited by 167
(2020) · neural information processing systems · Cited by 142
Fairness in rankings and recommendations: an overview
Pitoura, E., Stefanidis, K., & Koutrika, G. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00697-y · Cited by 177
Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines
Cachat-Rosset, G., & Klarsfeld, A. (2023) · Applied Artificial Intelligence · doi:10.1080/08839514.2023.2176618 · Cited by 138
Addressing age-related bias in sentiment analysis,
Diaz, M., Johnson, I., Lazar, A., Piper, A. M., & Gergle, D. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173986 · Cited by 138
Poisoning Web-Scale Training Datasets is Practical
Carlini, N., Jagielski, M., Choquette-Choo, C. A., Paleka, D., Pearce, W., Anderson, H., Terzis, A., Thomas, K., & Tramèr, F. (2024) · 2024 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp54263.2024.00179 · Cited by 138
Fairness in Graph Mining: A Survey
Dong, Y., Ma, J., Wang, S., Chen, C., & Li, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3265598 · Cited by 161
Ageism in the era of digital platforms
Rosales, A., & Fernández-Ardèvol, M. (2020) · Convergence: The International Journal of Research into New Media Technologies · doi:10.1177/1354856520930905 · Cited by 137
A survey on bias in visual datasets
Fabbrizzi, S., Papadopoulos, S., Ntoutsi, E., & Kompatsiaris, I. Y. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103552 · Cited by 164
Poisoning Web-Scale Training Datasets is Practical
Carlini, N., Jagielski, M., Choquette-Choo, C. A., Paleka, D., Pearce, W., Anderson, H., Terzis, A., Thomas, K., & Tramèr, F. (2023) · arXiv · doi:10.48550/arxiv.2302.10149 · Cited by 138
“Possibly most important among these is that uncurated data has serious implications for fairness, bias, and ethics [8, 50, 77].”
BackgroundChristou, P. (2023) · The Qualitative Report · doi:10.46743/2160-3715/2023.6406 · Cited by 226
Veale, M., & Brass, I. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198838494.003.0006 · Cited by 329
Representation Bias in Data: A Survey on Identification and Resolution Techniques
Shahbazi, N., Yin, L., Asudeh, A., & Jagadish, H. V. (2023) · ACM Computing Surveys · doi:10.1145/3588433 · Cited by 178
Deconfounded Image Captioning: A Causal Retrospect
Yang, X., Zhang, H., & Cai, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3121705 · Cited by 136
A Framework for the Computational Linguistic Analysis of Dehumanization
Mendelsohn, J., Tsvetkov, Y., & Jurafsky, D. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00055 · Cited by 148
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646
Toward fairness in AI for people with disabilities SBG@a research roadmap
Guo, A., Kamar, E., Vaughan, J. W., Wallach, H., & Morris, M. R. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386298 · Cited by 128
Contextualizing Hate Speech Classifiers with Post-hoc Explanation
Kennedy, B., Jin, X., Davani, A. M., Dehghani, M., & Ren, X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.483 · Cited by 150
Jointly De-Biasing Face Recognition and Demographic Attribute Estimation
Gong, S., Liu, X., & Jain, A. K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_20 · Cited by 141
Academic Policy Regarding Sustainability and Artificial Intelligence (AI)
Tanveer, M., Hassan, S., & Bhaumik, A. (2020) · Sustainability · doi:10.3390/su12229435 · Cited by 149
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies
Dev, S., Monajatipoor, M., Ovalle, A., Subramonian, A., Phillips, J. M., & Chang, K.-W. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.150 · Cited by 173
Self-citationA healthy debate: Exploring the views of medical doctors on the ethics of artificial intelligence
Martinho, A., Kroesen, M., & Chorus, C. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102190 · Cited by 124
Loureiro, D., & Jorge, A. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1569 · Cited by 130
Fair Attribute Classification through Latent Space De-biasing
Ramaswamy, V., Kim, S. S. Y., & Russakovsky, O. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00918 · Cited by 122
Barikeri, S., Lauscher, A., Vulić, I., & Glavaš, G. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.151 · Cited by 121
Understanding and Mitigating Annotation Bias in Facial Expression Recognition
Chen, Y., & Joo, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01471 · Cited by 126
The life cycle of large language models in education: A framework for understanding sources of bias
Lee, J., Hicke, Y., Yu, R., Brooks, C., & Kizilcec, R. F. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13505 · Cited by 119
Evolution and impact of bias in human and machine learning algorithm interaction
Sun, W., Nasraoui, O., & Shafto, P. (2020) · PLOS ONE · doi:10.1371/journal.pone.0235502 · Cited by 116
Springer, A., & Whittaker, S. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302322 · Cited by 115
“Major public concerns have arisen following demonstrations of bias in algorithmic systems with regards to gender, race, and other characteristics [9,75,79].”
BackgroundInfluentialAn Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models
Meade, N., Poole-Dayan, E., & Reddy, S. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.132 · Cited by 135
Perturbation Sensitivity Analysis to Detect Unintended Model Biases
Prabhakaran, V., Hutchinson, B., & Mitchell, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1578 · Cited by 115
Finding Microaggressions in the Wild: A Case for Locating Elusive Phenomena in Social Media Posts
Breitfeller, L., Ahn, E. P., Jurgens, D., & Tsvetkov, Y. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1176 · Cited by 115
Bongard, J., & Levin, M. G. (2021) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2021.650726 · Cited by 132
Garrido-Muñoz, I., Montejo-Ráez, A., Martínez-Santiago, F., & Ureña-López, L. A. (2021) · Applied Sciences · doi:10.3390/app11073184 · Cited by 123
Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective
Kiritchenko, S., Nejadgholi, I., & Fraser, K. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12590 · Cited by 126
Gender-preserving Debiasing for Pre-trained Word Embeddings
Kaneko, M., & Bollegala, D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1160 · Cited by 127
Like Trainer, Like Bot? Inheritance of Bias in Algorithmic Content Moderation
Binns, R., Veale, M., Kleek, M. G. V., & Shadbolt, N. (2017) · UCL Discovery (University College London) · Cited by 113
Women also Snowboard: Overcoming Bias in Captioning ModelsPreprint
Hendricks, L. A., Burns, K., Saenko, K., Darrell, T., & Rohrbach, A. (2018) · European Conference on Computer Vision · doi:10.48550/arxiv.1803.09797 · Cited by 536
Investigating Gender Bias in BERT
Bhardwaj, R., Majumder, N., & Poria, S. (2021) · Cognitive Computation · doi:10.1007/s12559-021-09881-2 · Cited by 112
SECNLP: A survey of embeddings in clinical natural language processing
Kalyan, K. S., & Sangeetha, S. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103323 · Cited by 111
Exploring author gender in book rating and recommendation
Ekstrand, M. D., Tian, M., Kazi, M. I. R., Mehrpouyan, H., & Kluver, D. (2018) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3240323.3240373 · Cited by 110
Understanding Undesirable Word Embedding Associations
Ethayarajh, K., Duvenaud, D., & Hirst, G. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1166 · Cited by 110
A Perspective on Explanations of Molecular Prediction Models
Wellawatte, G. P., Gandhi, H. A., Seshadri, A., & White, A. D. (2023) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.2c01235 · Cited by 119
Measuring and Reducing Gendered Correlations in Pre-trained Models
Webster, K., Wang, X., Tenney, I., Beutel, A., Pitler, E., Pavlick, E., Chen, J., Chi, E., & Petrov, S. (2020) · arXiv · doi:10.48550/arxiv.2010.06032 · Cited by 195
A survey of cross-lingual embedding models.
Ruder, S. (2017) · Cited by 107
It’s All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution
Maudslay, R. H., Gonen, H., Cotterell, R., & Teufel, S. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1530 · Cited by 107
Toward creating a fairer ranking in search engine results
Gao, R., & Shah, C. S. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102138 · Cited by 114
Sailer, M., Bauer, E., Hofmann, R., Kiesewetter, J., Glas, J., Gurevych, I., & Fischer, F. (2023) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101620 · Cited by 106
Privacy and Fairness in Federated Learning: On the Perspective of Tradeoff
Chen, H., Zhu, T., Zhang, T., Zhou, W., & Yu, P. S. (2023) · ACM Computing Surveys · doi:10.1145/3606017 · Cited by 118
Lawson, M. A., Martin, A. E., Huda, I., & Matz, S. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2026443119 · Cited by 126
Pessach, D., & Shmueli, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-24628-9_37 · Cited by 235
Challenges and Opportunities of Text-Based Emotion Detection: A Survey
Maruf, A. A., Khanam, F., Haque, M. M., Jiyad, Z. M., Mridha, M. F., & Aung, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3356357 · Cited by 126
Conditional variance penalties and domain shift robustness
Heinze‐Deml, C., & Meinshausen, N. (2020) · Machine Learning · doi:10.1007/s10994-020-05924-1 · Cited by 132
Using machine learning to revisit the diversification–performance relationship
Choi, J.-H., Menon, A. R., & Tabakovic, H. (2021) · Strategic Management Journal · doi:10.1002/smj.3317 · Cited by 108
It’s Morphin’ Time! Combating Linguistic Discrimination with Inflectional Perturbations
Tan, S., Joty, S., Kan, M., & Socher, R. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.263 · Cited by 111
Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections
Zhong, R., Lee, K., Zhang, Z., & Klein, D. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.244 · Cited by 152
Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem
Saunders, D., & Byrne, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.690 · Cited by 100
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103
Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translation
Vanmassenhove, E., Shterionov, D., & Gwilliam, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.188 · Cited by 99
Social Bias in Elicited Natural Language Inferences
Rudinger, R., May, C., & Durme, B. V. (2017) · doi:10.18653/v1/w17-1609 · Cited by 98
Stereotypical Bias Removal for Hate Speech Detection Task using Knowledge-based Generalizations
Badjatiya, P., Gupta, M., & Varma, V. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313504 · Cited by 97
Defining the Scope of AI Regulations
Schuett, J. (2019) · Law Innovation and Technology · doi:10.1080/17579961.2023.2184135 · Cited by 186
Variational Pretraining for Semi-supervised Text Classification
Gururangan, S., Dang, T., Card, D., & Smith, N. A. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1590 · Cited by 108
HONEST: Measuring Hurtful Sentence Completion in Language Models
Nozza, D., Bianchi, F., & Hovy, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.191 · Cited by 95
Incorporating Priors with Feature Attribution on Text Classification
Liu, F., & Avci, B. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1631 · Cited by 120
Explicitly unbiased large language models still form biased associations
Bai, X., Wang, A., Sucholutsky, I., & Griffiths, T. L. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2416228122 · Cited by 306
Equalizing Gender Bias in Neural Machine Translation with Word Embeddings Techniques
Font, J. E., & Costa-jussà, M. (2019) · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · doi:10.18653/v1/w19-3821 · Cited by 187
Explaining the Principles to Practices Gap in AI
Schiff, D. S., Rakova, B., Ayesh, A., Fanti, A., & Lennon, M. (2021) · IEEE Technology and Society Magazine · doi:10.1109/mts.2021.3056286 · Cited by 111
Retiring Adult: New Datasets for Fair Machine LearningPreprint
Ding, F., Hardt, M., Miller, J. A., & Schmidt, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04884 · Cited by 137
Debiasing Pre-trained Contextualised Embeddings
Kaneko, M., & Bollegala, D. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.107 · Cited by 134
On the Privacy Risks of Algorithmic Fairness
Chang, H., & Shokri, R. (2021) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp51992.2021.00028 · Cited by 107
Algorithmic Glass Ceiling in Social Networks
Stoica, A.-A., Riederer, C., & Chaintreau, A. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186140 · Cited by 95
Explicit Bias Discovery in Visual Question Answering Models
Manjunatha, V., Saini, N., & Davis, L. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00979 · Cited by 89
Roccetti, M., Delnevo, G., Casini, L., & Cappiello, G. (2019) · Journal Of Big Data · doi:10.1186/s40537-019-0235-y · Cited by 96
Towards Controllable Biases in Language Generation
Sheng, E., Chang, K.-W., Natarajan, P., & Peng, N. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.291 · Cited by 123
Self-citationMulti-Dimensional Gender Bias Classification
Dinan, E., Fan, A., Wu, L., Weston, J., Kiela, D., & Williams, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.23 · Cited by 117
#MeToo Alexa: How Conversational Systems Respond to Sexual Harassment
Curry, A. C., & Rieser, V. (2018) · doi:10.18653/v1/w18-0802 · Cited by 87
Neuroprediction and A.I. in Forensic Psychiatry and Criminal Justice: A Neurolaw Perspective
Tortora, L., Meynen, G., Bijlsma, J., Tronci, E., & Ferracuti, S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00220 · Cited by 104
Metadata
- Authors
- Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A.
- Affiliations
- Boston University (US)
- Microsoft Research New England (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1607.06520
- OpenAlex
- W2483215953
- Cited by
- 1,615
- References
- 33
- Citations by year
- 2026: 17 · 2025: 136 · 2024: 201 · 2023: 240 · 2022: 154 · 2021: 313 · 2020: 253 · 2019: 204 · 2018: 69 · 2017: 26 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- OpenBU (Boston University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- gender bias, word embeddings, bias mitigation, gender stereotypes, gender neutrality, analogy tasks, concept clustering, Google News, crowdsourced evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
