The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index.
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Open accessAbstract
The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning and natural language processing tasks. We show that even word embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent. This raises concerns because their widespread use, as we describe, often tends to amplify these biases. Geometrically, gender bias is first shown to be captured by a direction in the word embedding. Second, gender neutral words are shown to be linearly separable from gender definition words in the word embedding. Using these properties, we provide a methodology for modifying an embedding to remove gender stereotypes, such as the association between between the words receptionist and female, while maintaining desired associations such as between the words queen and female. We define metrics to quantify both direct and indirect gender biases in embeddings, and develop algorithms to "debias" the embedding. Using crowd-worker evaluation as well as standard benchmarks, we empirically demonstrate that our algorithms significantly reduce gender bias in embeddings while preserving the its useful properties such as the ability to cluster related concepts and to solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“'Clean' text additionally has been misrepresented as being 'unbiased' against any community-a notion that has been strongly contested [22, 73, 130].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“temporality has been flagged as a potential source of difficulty in textual data, where models trained on historical text corpora, such as Google News articles, have been found to reproduce past social stereotypes (e.g. the word”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generative AI outputs tend to reproduce normative views and mirror societal biases for marginalized groups [15, 21, 36, 41, 42, 45, 53, 66, 72, 91], including PwD [10, 12, 39, 48, 54, 62, 77, 113].”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“natural language processing (NLP) algorithms for textual analysis can display recurrent gender biases (Bolukbasi et al. 2016), for instance, associating the word “doctor” with “father” and “nurse” with “mother””
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Bolukbasi et al. 2016
The cited source says what the claim attributes to it.
In the citing paper
“Some solutions even allow for the dataset to remain unchanged while the ML algorithm is tuned to produce more robust or socially equitable outcomes [14,29].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“The seminal works of Bolukbasi et al. (2016) and Caliskan et al. (2017) show that word embeddings such as word2vec (Mikolov et al., 2013) and GloVe (Pennington et al., 2014) contain stereotypical biases using diagnostic methods like word analogies and association tests.”
From StereoSet: Measuring stereotypical bias in pretrained language models (2021) · cites this paper as Bolukbasi et al. (2016)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,529
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Research works printed but not linked: 7
- [5][5] A. J. Cuddy, E. B. Wolf, P. Glick, S. Crotty, J. Chong, and M. I. Norton. Men as cultural ideals: Cultural values moderate gender stereotype content. Journal of personality and social psychology , 109(4):622, 2015. -
- [6][6] A. Datta, M. C. Tschantz, and A. Datta. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies , 2015. -
- [11][11] C. Fellbaum, editor. Wordnet: An Electronic Lexical Database . The MIT Press, Cambridge, MA, 1998. -
- [13][13] P. Glick and S. T. Fiske. The ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of personality and social psychology , 70(3):491, 1996. -
- [16][16] C. Hansen, M. Tosik, G. Goossen, C. Li, L. Bayeva, F. Berbain, and M. Rotaru. How to get the best word vectors for resume parsing. In SNN Adaptive Intelligence / Symposium: Machine Learning 2015, Nijmegen. -
- [20][20] J. T. Jost and A. C. Kay. Exposure to benevolent sexism and complementary gender stereotypes: consequences for specific and diffuse forms of system justification. Journal of personality and social psychology , 88(3):498, 2005. -
- [35][35] J. P. Stanley. Paradigmatic woman: The prostitute. Papers in language variation , pages 303-321, 1977. -
Cited by
Sorted by citations
Items 301–400 of 1,022
Gender stereotype reinforcement: Measuring the gender bias conveyed by ranking algorithms
Fabris, A., Purpura, A., Silvello, G., & Susto, G. A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102377 · Cited by 63
Müller, S. R., Chen, X., Peters, H., Chaintreau, A., & Matz, S. C. (2021) · Scientific Reports · doi:10.1038/s41598-021-93087-x · Cited by 51
Chaloner, K., & Maldonado, A. (2019) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/w19-3804 · Cited by 52
Karamcheti, S., Krishna, R., Fei-Fei, L., & Manning, C. D. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.564 · Cited by 62
Huang, L., Huhulea, E. N., Abraham, E., Bienenstock, R., Aifuwa, E., Hirani, R., Schulhof, A., Tiwari, R. K., & Etienne, M. (2025) · Medicina · doi:10.3390/medicina61020358 · Cited by 60
Data science vs. statistics: two cultures?
Carmichael, I. D., & Marron, J. S. (2018) · Japanese Journal of Statistics and Data Science · doi:10.1007/s42081-018-0009-3 · Cited by 51
Distributed semantic representations for modeling human judgment
Bhatia, S., Richie, R., & Zou, W. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.01.020 · Cited by 57
Are We Consistently Biased? Multidimensional Analysis of Biases in Distributional Word Vectors
Lauscher, A., & Glavaš, G. (2019) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s19-1010 · Cited by 55
Exploring What Is Encoded in Distributional Word Vectors: A Neurobiologically Motivated Analysis
Utsumi, A. (2020) · Cognitive Science · doi:10.1111/cogs.12844 · Cited by 61
Collaboration Analytics — Current State and Potential Futures
Schneider, B., Dowell, N., & Thompson, K. (2021) · Journal of Learning Analytics · doi:10.18608/jla.2021.7447 · Cited by 56
Offenwanger, A., Milligan, A. J., Chang, M., Bullard, J., & Yoon, D. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445383 · Cited by 52
Rozado, D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231189 · Cited by 61
Multiple-Attribute Text Style TransferPreprint
Subramanian, S., Lample, G., Smith, E. M., Denoyer, L., Ranzato, M., & Boureau, Y.-L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00552 · Cited by 51
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search
Wang, J., Liu, Y., & Wang, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.151 · Cited by 98
FrameAxis: characterizing microframe bias and intensity with word embedding
Kwak, H., An, J., Jing, E., & Ahn, Y. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.644 · Cited by 59
Lyu, L., He, X., & Li, Y. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.213 · Cited by 51
Integrating semantic directions with concept mover’s distance to measure binary concept engagement
Taylor, M. A., & Stoltz, D. S. (2020) · Journal of Computational Social Science · doi:10.1007/s42001-020-00075-8 · Cited by 49
Quantifying Societal Bias Amplification in Image Captioning
Hirota, Y., Nakashima, Y., & García, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01309 · Cited by 56
Fairness-Aware Machine Learning
Bird, S., Kenthapadi, K., Kıcıman, E., & Mitchell, M. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3291383 · Cited by 49
Unintended machine learning biases as social barriers for persons with disabilitiess
Hutchinson, B., Prabhakaran, V., Denton, R., Webster, K., Zhong, Y., & Denuyl, S. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386305 · Cited by 49
Mitigating Gender Bias in Captioning Systems
Tang, R., Du, M., Li, Y., Liu, Z., Zou, N., & Hu, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449950 · Cited by 50
Unmasking the Mask – Evaluating Social Biases in Masked Language Models
Kaneko, M., & Bollegala, D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21453 · Cited by 60
Evaluating and Mitigating Bias in Image Classifiers: A Causal Perspective Using Counterfactuals
Dash, S., Balasubramanian, V. N., & Sharma, A. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00393 · Cited by 59
Bias in Machine Learning -- What is it Good for?Preprint
Hellström, T., Dignum, V., & Bensch, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00686 · Cited by 107
Modifying Memories in Transformer Models
Zhu, C., Rawat, A. S., Zaheer, M., Bhojanapalli, S., Li, D., Yu, F., & Kumar, S. (2020) · arXiv · doi:10.48550/arxiv.2012.00363 · Cited by 48
Cao, Y. T., & Daumé, H. (2021) · Computational Linguistics · doi:10.1162/coli_a_00413 · Cited by 47
“…than just in coreference resolution, including, for instance, natural language inference (Rudinger, May, and Van Durme 2017), word embeddings (e.g., Bolukbasi et al. 2016; Romanov et al. 2019; Gonen and Goldberg 2019), sentiment analysis (Kiritchenko and Mohammad 2018), machine translation (Font…”
BackgroundUsing fair AI to predict students’ math learning outcomes in an online platform
Li, C., Xing, W., & Leite, W. L. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2115076 · Cited by 55
Hate Speech Classifiers Learn Normative Social Stereotypes
Davani, A. M., Atari, M., Kennedy, B., & Dehghani, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00550 · Cited by 73
Unsupervised Discovery of Implicit Gender Bias
Field, A., & Tsvetkov, Y. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.44 · Cited by 58
Gender inequities in the online dissemination of scholars’ work
Vásárhelyi, O., Zakhlebin, I., Milojević, S., & Horvát, E.-Á. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2102945118 · Cited by 52
Guilty by Association: Using Word Embeddings to Measure Ethnic Stereotypes in News Coverage
Kroon, A. C., Trilling, D., & Raats, T. (2020) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699020932304 · Cited by 46
A Systematic Review on Social Sustainability of Artificial Intelligence in Product Design
Lee, K. (2021) · Sustainability · doi:10.3390/su13052668 · Cited by 46
Zheng, Y., Wang, S., & Zhao, J. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103410 · Cited by 51
Lee, M. H. J., Montgomery, J., & Lai, C. K. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658975 · Cited by 72
These are not the Stereotypes You are Looking For: Bias and Fairness in Authorial Gender Attribution
Koolen, C., & van Cranenburgh, A. (2017) · doi:10.18653/v1/w17-1602 · Cited by 46
Tang, S., Zhang, X., Cryan, J., Metzger, M. J., Zheng, H.-T., & Zhao, B. Y. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134734 · Cited by 47
Debiasing Embeddings for Reduced Gender Bias in Text Classification
Prost, F., Thain, N., & Bolukbasi, T. (2019) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/w19-3810 · Cited by 48
Self-citationFadziso, T. (2019) · Asia Pacific Journal of Energy and Environment · doi:10.18034/apjee.v6i2.542 · Cited by 51
Silva, A., Tambwekar, P., & Gombolay, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.189 · Cited by 46
Data Governance in the Age of Large-Scale Data-Driven Language Technology
Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534637 · Cited by 75
BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?
Ushio, A., Espinosa-Anke, L., Schockaert, S., & Camacho-Collados, J. (2021) · doi:10.18653/v1/2021.acl-long.280 · Cited by 69
A fused large language model for predicting startup success
Maarouf, A., Feuerriegel, S., & Pröllochs, N. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.09.011 · Cited by 61
Including Vulnerable Populations in the Assessment of Data From Vulnerable Populations
Jackson, L., Kuhlman, C., Jackson, F. L. C., & Fox, P. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00019 · Cited by 45
What You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring
Peng, A., Nushi, B., Kıcıman, E., Inkpen, K. M., Suri, S., & Kamar, E. S. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5281 · Cited by 44
Detecting Gender Stereotypes: Lexicon vs. Supervised Learning Methods
Cryan, J., Tang, S., Zhang, X., Metzger, M. J., Zheng, H.-T., & Zhao, B. Y. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376488 · Cited by 45
Equalizing Gender Biases in Neural Machine Translation with Word Embeddings TechniquesPreprint
Font, J. E., & Costa‐jussà, M. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03116 · Cited by 45
Gender Attitudes in the Judiciary: Evidence from U.S. Circuit CourtsPreprint
Ash, E., Chen, D. L., & Ornaghi, A. (2021) · RePEc: Research Papers in Economics · doi:10.3929/ethz-b-000472797 · Cited by 45
Fairness in representation: quantifying stereotyping as a representational harm
Abbasi, M., Friedler, S. A., Scheidegger, C., & Venkatasubramanian, S. (2019) · Proceedings of the 2019 SIAM International Conference on Data Mining · doi:10.1137/1.9781611975673.90 · Cited by 44
“There have been a few works that look at bias that emerges from the representation process, most notably when looking at learned representations that come from word-vector embeddings[4, 8, 33, 14].”
BackgroundAnalyzing the impact of missing values and selection bias on fairness
Wang, Y., & Singh, L. (2021) · International Journal of Data Science and Analytics · doi:10.1007/s41060-021-00259-z · Cited by 55
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
Fernandes, P., Madaan, A., Liu, E., Farinhas, A., Martins, P. H., Bertsch, A., de Souza, J. G. C., Zhou, S., Wu, T., Neubig, G., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00626 · Cited by 94
Omeish, F. Y., Khasawneh, M. H. A., & Khair, N. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100464 · Cited by 78
Gender bias in (neuro)science: Facts, consequences, and solutions
Schrouff, J., Pischedda, D., Genon, S., Fryns, G., Pinho, A. L., Vassena, E., Liuzzi, A. G., & Ferreira, F. S. (2019) · European Journal of Neuroscience · doi:10.1111/ejn.14397 · Cited by 44
“You are grounded!”: Latent Name Artifacts in Pre-trained Language Models
Shwartz, V., Rudinger, R., & Tafjord, O. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.556 · Cited by 52
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation
Wang, T., Lin, X., Rajani, N. F., McCann, B., Ordóñez, V., & Xiong, C. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.484 · Cited by 62
Who's Learning? Using Demographics in EDM Research
Paquette, L., Ocumpaugh, J. L., Li, Z., Andres, A., & Baker, R. S. (2020) · Journal of Educational Data Mining · doi:10.5281/zenodo.4143611 · Cited by 48
Debiasing knowledge graph embeddings
Fisher, J., Mittal, A., Palfrey, D., & Christodoulopoulos, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.595 · Cited by 47
Shen, T., Li, J., Bouadjenek, M. R., Mai, Z., & Sanner, S. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103139 · Cited by 57
Good Secretaries, Bad Truck Drivers? Occupational Gender Stereotypes in Sentiment Analysis
Bhaskaran, J., & Bhallamudi, I. (2019) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/w19-3809 · Cited by 51
Will artificial intelligence eventually replace psychiatrists?
Brown, C., Story, G. W., Mourão-Miranda, J., & Baker, J. T. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.245 · Cited by 50
Quantifying Gender Bias in Different Corpora
Babaeianjelodar, M., Lorenz, S., Gordon, J., Matthews, J. N., & Freitag, E. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3383559 · Cited by 42
Nascimento, F. R. S., Cavalcanti, G. D. C., & Costa‐Abreu, M. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117032 · Cited by 49
Criado, N., & Such, J. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198838494.003.0004 · Cited by 46
Are All Training Examples Created Equal? An Empirical StudyPreprint
Vodrahalli, K., Li, K., & Malik, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12569 · Cited by 61
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning
Jin, X., Barbieri, F., Kennedy, B., Davani, A. M., Neves, L., & Ren, X. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.296 · Cited by 63
Balancing innovation and regulation in the age of generative artificial intelligence
Wang, X., & Wu, Y. C. (2024) · Journal of Information Policy · doi:10.5325/jinfopoli.14.2024.0012 · Cited by 42
Simbeck, K. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2915067 · Cited by 53
Gender Representation in French Broadcast Corpora and Its Impact on ASR Performance
Garnerin, M., Rossato, S., & Besacier, L. (2019) · International Workshop on AI for Smart TV Content Production, Access and Delivery (AI4TV) · doi:10.1145/3347449.3357480 · Cited by 42
User feedback in the app store
Guzmán, E., Oliveira, L., Steiner, Y., Wagner, L. C., & Glinz, M. (2018) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1145/3183428.3183436 · Cited by 41
Fairness in Learning-Based Sequential Decision Algorithms: A Survey
Zhang, X., & Liu, M. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-60990-0_18 · Cited by 49
We Don't Speak the Same Language: Interpreting Polarization through Machine Translation
KhudaBukhsh, A. R., Sarkar, R., Kamlet, M. S., & Mitchell, T. M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17748 · Cited by 42
Ethics and artificial intelligence
Galiana, L. I., Corral-Gudino, L., & Miramontes‐González, J. P. (2024) · Revista Clínica Española (English Edition) · doi:10.1016/j.rceng.2024.02.003 · Cited by 53
Challenges and Prospects in Vision and Language Research
Kafle, K., Shrestha, R., & Kanan, C. (2019) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2019.00028 · Cited by 37
On the Morality of Artificial Intelligence [Commentary]
Luccioni, A. S., & Bengio, Y. (2020) · IEEE Technology and Society Magazine · doi:10.1109/mts.2020.2967486 · Cited by 65
Towards Robustifying NLI Models Against Lexical Dataset Biases
Zhou, X., & Bansal, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.773 · Cited by 43
Barlas, P., Kyriakou, K., Guest, O., Kleanthous, S., & Otterbacher, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432931 · Cited by 41
The Gender Gap Tracker: Using Natural Language Processing to measure gender bias in media
Asr, F. T., Mazraeh, M., Lopes, A., Gautam, V., Gonzales, J., Rao, P. P., & Taboada, M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245533 · Cited by 53
Explainable Student Agency Analytics
Saarela, M., Heilala, V., Jääskelä, P., Rantakaulio, A., & Kärkkäinen, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116664 · Cited by 48
Principles of Explainable Artificial Intelligence
Guidotti, R., Monreale, A., Pedreschi, D., & Giannotti, F. (2021) · Springer eBooks · doi:10.1007/978-3-030-76409-8_2 · Cited by 47
Integrating topic modeling and word embedding to characterize violent deaths
Arseniev‐Koehler, A., Cochran, S. D., Mays, V. M., Chang, K.-W., & Foster, J. G. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2108801119 · Cited by 50
Self-citationHou, T.-Y., Tseng, Y.-C., & Yuan, C. W. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102775 · Cited by 43
Bayesian Modeling of Intersectional Fairness: The Variance of Bias
Foulds, J. R., Islam, R., Keya, K. N., & Pan, S. (2020) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976236.48 · Cited by 41
Wilson, S. R., Close, M. E., Abraham, P., Sarris, T. S., Banasiak, L. J., Stenger, R., & Hadfield, J. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.135877 · Cited by 39
Towards a Comprehensive Taxonomy and Large-Scale Annotated Corpus for Online Slur Usage
Kurrek, J., Saleem, H. M., & Ruths, D. A. (2020) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2020.alw-1.17 · Cited by 38
Natural Language Processing in Marketing
Hartmann, J., & Netzer, O. (2023) · Artificial Intelligence in Marketing · doi:10.1108/s1548-643520230000020011 · Cited by 38
Huang, X., Liu, Z. Y., Zhang, M., 桂, 韬., 韩, 先., 户, 保., 黄, 民., 黄, 萱., 刘, 康., 刘, 挺., et al. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2023-0113 · Cited by 42
Prompt architecture induces methodological artifacts in large language models
Brucks, M. S., & Toubia, O. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319159 · Cited by 58
Gender and Racial Fairness in Depression Research using Social Media
Aguirre, C., Harrigian, K., & Dredze, M. H. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.256 · Cited by 41
Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Model
Fraser, K., Nejadgholi, I., & Kiritchenko, S. (2021) · doi:10.18653/v1/2021.acl-long.50 · Cited by 47
Can You Trust Your Autonomous Car? Interpretable and Verifiably Safe Reinforcement Learning
Schmidt, L. M., Kontes, G. D., Plinge, A., & Mutschler, C. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575328 · Cited by 39
Word2Vec: Optimal hyperparameters and their impact on natural language processing downstream tasks
Adewumi, T., Liwicki, F., & Liwicki, M. (2022) · Open Computer Science · doi:10.1515/comp-2022-0236 · Cited by 49
Analytical Methods for Interpretable Ultradense Word Embeddings
Dufter, P., & Schütze, H. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1111 · Cited by 37
Authentic Integration of Ethics and AI through Sociotechnical, Problem-Based Learning
Krakowski, A., Greenwald, E., Hurt, T., Nonnecke, B. M., & Cannady, M. A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21556 · Cited by 44
Gender stereotypes in AI-generated images
García-Ull, F. J., & Lázaro, M. M. (2023) · El Profesional de la Informacion · doi:10.3145/epi.2023.sep.05 · Cited by 54
Nofal, A., Ali, H. M., Hadi, M., Ahmad, A., Qayyum, A., Johri, A., Al‐Fuqaha, A., & Qadir, J. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100347 · Cited by 51
Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning
Schuster, R., Schuster, T., Meri, Y., & Shmatikov, V. (2020) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40000.2020.00115 · Cited by 34
Contextual word representations
Smith, N. A. (2020) · Communications of the ACM · doi:10.1145/3347145 · Cited by 46
Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddings
Zhang, H., Lu, A. X., Abdalla, M., McDermott, M., & Ghassemi, M. (2020) · arXiv · doi:10.48550/arxiv.2003.11515 · Cited by 37
Bridging the Gap Between Ethical AI Implementations
Alahmed, Y., Abadla, R., Ameen, N., & Shteiwi, A. (2023) · International Journal of Membrane Science and Technology · doi:10.15379/ijmst.v10i3.2953 · Cited by 39
Big data in education and the models that love them
Pardos, Z. A. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.11.006 · Cited by 38
Quijano-Sánchez, L., Liberatore, F., Camacho-Collados, J., & Camacho‐Collados, M. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.03.010 · Cited by 44
Metadata
- Authors
- Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A.
- Affiliations
- Boston University (US)
- Microsoft Research New England (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1607.06520
- OpenAlex
- W2483215953
- Cited by
- 1,615
- References
- 33
- Citations by year
- 2026: 17 · 2025: 136 · 2024: 201 · 2023: 240 · 2022: 154 · 2021: 313 · 2020: 253 · 2019: 204 · 2018: 69 · 2017: 26 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- OpenBU (Boston University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- gender bias, word embeddings, bias mitigation, gender stereotypes, gender neutrality, analogy tasks, concept clustering, Google News, crowdsourced evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
