The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index.
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Open accessAbstract
The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning and natural language processing tasks. We show that even word embeddings trained on Google News articles exhibit female/male gender stereotypes to a disturbing extent. This raises concerns because their widespread use, as we describe, often tends to amplify these biases. Geometrically, gender bias is first shown to be captured by a direction in the word embedding. Second, gender neutral words are shown to be linearly separable from gender definition words in the word embedding. Using these properties, we provide a methodology for modifying an embedding to remove gender stereotypes, such as the association between between the words receptionist and female, while maintaining desired associations such as between the words queen and female. We define metrics to quantify both direct and indirect gender biases in embeddings, and develop algorithms to "debias" the embedding. Using crowd-worker evaluation as well as standard benchmarks, we empirically demonstrate that our algorithms significantly reduce gender bias in embeddings while preserving the its useful properties such as the ability to cluster related concepts and to solve analogy tasks. The resulting embeddings can be used in applications without amplifying gender bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“'Clean' text additionally has been misrepresented as being 'unbiased' against any community-a notion that has been strongly contested [22, 73, 130].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“temporality has been flagged as a potential source of difficulty in textual data, where models trained on historical text corpora, such as Google News articles, have been found to reproduce past social stereotypes (e.g. the word”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generative AI outputs tend to reproduce normative views and mirror societal biases for marginalized groups [15, 21, 36, 41, 42, 45, 53, 66, 72, 91], including PwD [10, 12, 39, 48, 54, 62, 77, 113].”
From Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“natural language processing (NLP) algorithms for textual analysis can display recurrent gender biases (Bolukbasi et al. 2016), for instance, associating the word “doctor” with “father” and “nurse” with “mother””
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Bolukbasi et al. 2016
The cited source says what the claim attributes to it.
In the citing paper
“Some solutions even allow for the dataset to remain unchanged while the ML algorithm is tuned to produce more robust or socially equitable outcomes [14,29].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“The seminal works of Bolukbasi et al. (2016) and Caliskan et al. (2017) show that word embeddings such as word2vec (Mikolov et al., 2013) and GloVe (Pennington et al., 2014) contain stereotypical biases using diagnostic methods like word analogies and association tests.”
From StereoSet: Measuring stereotypical bias in pretrained language models (2021) · cites this paper as Bolukbasi et al. (2016)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,529
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Research works printed but not linked: 7
- [5][5] A. J. Cuddy, E. B. Wolf, P. Glick, S. Crotty, J. Chong, and M. I. Norton. Men as cultural ideals: Cultural values moderate gender stereotype content. Journal of personality and social psychology , 109(4):622, 2015. -
- [6][6] A. Datta, M. C. Tschantz, and A. Datta. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies , 2015. -
- [11][11] C. Fellbaum, editor. Wordnet: An Electronic Lexical Database . The MIT Press, Cambridge, MA, 1998. -
- [13][13] P. Glick and S. T. Fiske. The ambivalent sexism inventory: Differentiating hostile and benevolent sexism. Journal of personality and social psychology , 70(3):491, 1996. -
- [16][16] C. Hansen, M. Tosik, G. Goossen, C. Li, L. Bayeva, F. Berbain, and M. Rotaru. How to get the best word vectors for resume parsing. In SNN Adaptive Intelligence / Symposium: Machine Learning 2015, Nijmegen. -
- [20][20] J. T. Jost and A. C. Kay. Exposure to benevolent sexism and complementary gender stereotypes: consequences for specific and diffuse forms of system justification. Journal of personality and social psychology , 88(3):498, 2005. -
- [35][35] J. P. Stanley. Paradigmatic woman: The prostitute. Papers in language variation , pages 303-321, 1977. -
Cited by
Sorted by citations
Items 201–300 of 1,022
Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information?
Springer, A., & Whittaker, S. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3374218 · Cited by 84
Gentzkow, M. A., Kelly, B. T., & Taddy, M. A. (2017) · National Bureau of Economic Research · doi:10.3386/w23276 · Cited by 85
Mohammad, S. M. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-821124-3.00011-9 · Cited by 101
A Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
Understanding and Evaluating Racial Biases in Image Captioning
Zhao, D., Wang, A., & Russakovsky, O. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01456 · Cited by 85
Fairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 100
Abramski, K., Citraro, S., Lombardi, L., Rossetti, G., & Stella, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7030124 · Cited by 81
“For example, sexist and racist word analogies such as “father” is to “doctor” as “mother” is to “nurse” [29] and black is to criminal as Caucasian is to police [30] produced by word embeddings demonstrate how language contains biases that reflect adverse societal stereotypes.”
BackgroundDon’t Judge an Object by Its Context: Learning to Overcome Contextual Bias
Singh, K. K., Mahajan, D. K., Grauman, K. L., Lee, Y. J., Feiszli, M., & Ghadiyaram, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01108 · Cited by 87
Does Gender Matter? Towards Fairness in Dialogue Systems
Liu, H., Dacon, J., Fan, W., Liu, H., Liu, Z., & Tang, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.390 · Cited by 81
Improving fairness in machine learning systems: What do industry practitioners need?Preprint
Holstein, K., Vaughan, J. W., Daumé, H., Dudík, M., & Wallach, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05239 · Cited by 81
Copyright in generative deep learning
Franceschelli, G., & Musolesi, M. (2022) · Data & Policy · doi:10.1017/dap.2022.10 · Cited by 82
A Timely Intervention: Tracking the Changing Meanings of Political Concepts with Word Vectors
Rodman, E. (2020) · Political Analysis · doi:10.1017/pan.2019.23 · Cited by 112
The Power of Language: Gender, Status, and Agency in Performance Evaluations
Smith, D. G., Rosenstein, J. E., Nikolov, M. C., & Chaney, D. A. (2018) · Sex Roles · doi:10.1007/s11199-018-0923-7 · Cited by 81
Agrawal, A., Ali, A., & Boyd, S. (2021) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000090 · Cited by 82
Examining Gender Bias in Languages with Grammatical Gender
Zhou, P., Shi, W., Zhao, J., Huang, K.-H., Chen, M., Cotterell, R., & Chang, K.-W. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1531 · Cited by 81
Self-citationCounterfactual Inference for Text Classification Debiasing
Chen, Q., Feng, F., Wen, L., Ma, C., & Xie, P. (2021) · doi:10.18653/v1/2021.acl-long.422 · Cited by 80
Sannou, R. O., Kirschke, S., & Günther, E. (2023) · Sustainable Production and Consumption · doi:10.1016/j.spc.2023.05.014 · Cited by 87
De-Biased Court’s View Generation with Causality
Wu, Y., Kuang, K., Zhang, Y., Liu, X., Sun, C., Xiao, J., Zhuang, Y., Si, L., & Wu, F. Q. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.56 · Cited by 79
Unsupervised and self-supervised deep learning approaches for biomedical text mining
Nadif, M., & Role, F. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab016 · Cited by 78
Nuseir, M. T., Kurdi, B. H. A., Alshurideh, M. T., & Alzoubi, H. M. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-76346-6_28 · Cited by 78
Gender bias in AI-based decision-making systems: a systematic literature review
Nadeem, A., Marjanovic, O., & Abedin, B. (2022) · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · doi:10.3127/ajis.v26i0.3835 · Cited by 100
What are the Biases in My Word Embedding?
Swinger, N., De-Arteaga, M., Heffernan, N., Leiserson, M. D. M., & Kalai, A. (2018) · AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314270 · Cited by 110
Self-citationDon’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference
Belinkov, Y., Poliak, A., Shieber, S., Van Durme, B., & Rush, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1084 · Cited by 73
How language shapes prejudice against women: An examination across 45 world languages.
DeFranza, D., Mishra, H., & Mishra, A. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000188 · Cited by 80
Scruples: A Corpus of Community Ethical Judgments on 32, 000 Real-Life Anecdotes
Lourie, N., Le Bras, R., & Choi, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17589 · Cited by 73
Discrimination through optimization: How Facebook's ad delivery can lead to skewed outcomes
Ali, M., Sapiezynski, P., Bogen, M., Korolova, A., Mislove, A., & Rieke, A. (2019) · arXiv · doi:10.48550/arxiv.1904.02095 · Cited by 72
Mitigating Demographic Bias in AI-based Resume Filtering
Deshpande, K. V., Pan, S., & Foulds, J. R. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3386392.3399569 · Cited by 72
Czarnowska, P., Vyas, Y., & Shah, K. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00425 · Cited by 72
Michaelov, J. A., Seana Coulson, A., & Bergen, B. K. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3176783 · Cited by 77
Nbias: A natural language processing framework for BIAS identification in text
Raza, S., Garg, M., Reji, D. J., Bashir, S. R., & Ding, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121542 · Cited by 76
Auditing Search Engines for Differential Satisfaction Across Demographics
Mehrotra, R., Anderson, A., Díaz, F., Sharma, A. K., Wallach, H., & Yılmaz, E. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054197 · Cited by 72
Interactive Analysis of Word Vector Embeddings
Heimerl, F., & Gleicher, M. L. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13417 · Cited by 71
Fair Clustering via Equitable Group Representations
Abbasi, M., Bhaskara, A., & Venkatasubramanian, S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445913 · Cited by 79
What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A., & Viviano, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.24 · Cited by 69
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs
Barocas, S., Guo, A., Kamar, E., Krones, J., Morris, M. R., Vaughan, J. W., Wadsworth, W. D., & Wallach, H. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462610 · Cited by 72
Artificial Intelligence Will Transform Cardiac Imaging—Opportunities and Challenges
Petersen, S. E., Abdulkareem, M., & Leiner, T. (2019) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2019.00133 · Cited by 70
Empirical Analysis of Multi-Task Learning for Reducing Identity Bias in Toxic Comment Detection
Vaidya, A., Mai, F., & Ning, Y. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7334 · Cited by 87
Krupiy, T. (2020) · Computer law & security review · doi:10.1016/j.clsr.2020.105429 · Cited by 81
Exposing the limits of Zero-shot Cross-lingual Hate Speech Detection
Nozza, D. (2021) · doi:10.18653/v1/2021.acl-short.114 · Cited by 74
Quantifying and alleviating political bias in language models
Liu, R., Jia, C., Wei, J., Xu, G., & Vosoughi, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2021.103654 · Cited by 68
Ethical Considerations in AI Addressing Bias and Fairness in Machine Learning Models
Sreerama, J., & Krishnamoorthy, G. (2022) · Journal of Knowledge Learning and Science Technology · doi:10.60087/jklst.vol1.n1.p138 · Cited by 84
BiasFinder: Metamorphic Test Generation to Uncover Bias for Sentiment Analysis Systems
Asyrofi, M. H., Yang, Z., Yusuf, I. N. B., Kang, H. J., Thung, F., & Lo, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3136169 · Cited by 81
Datasheets for Datasets help ML Engineers Notice and Understand Ethical Issues in Training Data
Boyd, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479582 · Cited by 67
Envisioning Information Access Systems: What Makes for Good Tools and a Healthy Web?
Shah, C. S., & Bender, E. M. (2024) · ACM Transactions on the Web · doi:10.1145/3649468 · Cited by 86
Pardos, Z. A., Fan, Z., & Jiang, W. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09218-7 · Cited by 75
Perrone, V., Donini, M., Zafar, M. B., Schmucker, R., Kenthapadi, K., & Archambeau, C. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462629 · Cited by 66
Learnability and semantic universals
Steinert‐Threlkeld, S., & Szymanik, J. (2019) · Semantics and Pragmatics · doi:10.3765/sp.12.4 · Cited by 78
On Predicting Recidivism: Epistemic Risk, Tradeoffs, and Values in Machine Learning
Biddle, J. B. (2020) · Canadian Journal of Philosophy · doi:10.1017/can.2020.27 · Cited by 71
Exploring author gender in book rating and recommendation
Ekstrand, M. D., & Kluver, D. (2021) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-020-09284-2 · Cited by 66
Multilingualism and AI: The Regimentation of Language in the Age of Digital Capitalism
Schneider, B. (2022) · Signs and Society · doi:10.1086/721757 · Cited by 81
Lau, V. W.-Y., Scott, V. L., Warren, M. A., & Bligh, M. C. (2022) · Journal of Organizational Behavior · doi:10.1002/job.2654 · Cited by 85
Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias
Bartl, M., Nissim, M., & Gatt, A. (2020) · arXiv · doi:10.48550/arxiv.2010.14534 · Cited by 84
Mitigating Political Bias in Language Models through Reinforced Calibration
Liu, R., Jia, C., Wei, J., Xu, G., Wang, L., & Vosoughi, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17744 · Cited by 78
Mitigating Language-Dependent Ethnic Bias in BERT
Ahn, J., & Oh, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.42 · Cited by 64
Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech RecognitionPreprint
Huang, X., Xing, L., Dernoncourt, F., & Paul, M. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10361 · Cited by 75
Reducing Gender Bias in Word-Level Language Models with a Gender-Equalizing Loss Function
Qian, Y., Muaz, U., Zhang, B., & Hyun, J. W. (2019) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/p19-2031 · Cited by 63
Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender BiasPreprint
Vig, J., Gehrmann, S., Belinkov, Y., Qian, S., Nevo, D., Sakenis, S., Huang, J., Singer, Y., & Shieber, S. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12265 · Cited by 212
Text Analysis for Psychology: Methods, Principles, and PracticesPreprint
Kennedy, B., Ashokkumar, A., Boyd, R. L., & Dehghani, M. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h2b8t · Cited by 62
UNQOVERing Stereotyping Biases via Underspecified Questions
Li, T., Khashabi, D., Khot, T., Sabharwal, A., & Srikumar, V. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.311 · Cited by 124
Structural Ageism in Big Data Approaches
Rosales, A., & Fernández-Ardèvol, M. (2019) · Nordicom review/NORDICOM review · doi:10.2478/nor-2019-0013 · Cited by 69
Equity Beyond Bias in Language Technologies for Education
Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4446 · Cited by 62
FairFil: Contrastive Neural Debiasing Method for Pretrained Text EncodersPreprint
Cheng, P., Hao, W., Yuan, S., Si, S., & Carin, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06413 · Cited by 93
Chandler, C., Foltz, P. W., & Elvevåg, B. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sbz105 · Cited by 61
You reap what you sow: On the Challenges of Bias Evaluation Under Multilingual Settings
Talat, Z., Névéol, A., Biderman, S., Clinciu, M., Dey, M., Longpre, S., Luccioni, A. S., Masoud, M., Mitchell, M., Radev, D., et al. (2022) · doi:10.18653/v1/2022.bigscience-1.3 · Cited by 77
Theoretical Foundations and Limits of Word Embeddings: What Types of Meaning can They Capture?
Arseniev‐Koehler, A. (2022) · Sociological Methods & Research · doi:10.1177/00491241221140142 · Cited by 75
Gender biases within Artificial Intelligence and ChatGPT: Evidence, Sources of Biases and Solutions
Ho, J. Q. H., Hartanto, A., Koh, A., & Majeed, N. M. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100145 · Cited by 83
Opportunities and Challenges for Artificial Intelligence in India
Kalyanakrishnan, S., Panicker, R. A., Natarajan, S., & Rao, S. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278738 · Cited by 69
Situated algorithms: a sociotechnical systemic approach to bias
Draude, C., Klumbytė, G., Lücking, P., & Treusch, P. (2019) · Online Information Review · doi:10.1108/oir-10-2018-0332 · Cited by 77
Neural embeddings of scholarly periodicals reveal complex disciplinary organizations
Peng, H., Ke, Q., Budak, C., Romero, D. M., & Ahn, Y. (2021) · Science Advances · doi:10.1126/sciadv.abb9004 · Cited by 66
Gender Bias in Multilingual Embeddings and Cross-Lingual Transfer
Zhao, J., Mukherjee, S., Hosseini, S., Chang, K.-W., & Awadallah, A. H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.260 · Cited by 78
Self-citationA data-driven framework for mapping domains of human neurobiology
Beam, E., Potts, C., Poldrack, R. A., & Etkin, A. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00948-9 · Cited by 63
Fairness in Large Language Models: A Taxonomic Survey
Chu, Z., Wang, Z., & Zhang, W. (2024) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3682112.3682117 · Cited by 106
Artificial Intelligence and Medical Humanities
Ostherr, K. (2020) · Journal of Medical Humanities · doi:10.1007/s10912-020-09636-4 · Cited by 73
Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models
Manela, D. D. V., Errington, D., Fisher, T., van Breugel, B., & Minervini, P. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.190 · Cited by 67
Parray, A. A., Inam, Z. M., Ramonfaur, D., Haider, S. S., Mistry, S. K., & Pandya, A. K. (2023) · Global Transitions · doi:10.1016/j.glt.2023.05.001 · Cited by 60
Monday, C. U., Zaghloul, M. S., Krishnamurthy, D., & Achari, G. (2024) · Water · doi:10.3390/w16020305 · Cited by 59
People’s Councils for Ethical Machine Learning
McQuillan, D. (2018) · Social Media + Society · doi:10.1177/2056305118768303 · Cited by 72
O'Reilly-Shah, V. N., Gentry, K. R., Walters, A. M., Zivot, J., Anderson, C. T., & Tighe, P. J. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.07.040 · Cited by 62
Boutyline, A., Arseniev‐Koehler, A., & Cornell, D. (2023) · Social Forces · doi:10.1093/sf/soac148 · Cited by 57
An, J., Huang, D., Lin, C., & Tai, M. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf089 · Cited by 58
A Transparent Framework for Evaluating Unintended Demographic Bias in Word Embeddings
Sweeney, C., & Najafian, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1162 · Cited by 58
Semantics Derived Automatically from Language Corpora Contain Human-like Moral Choices
Jentzsch, S. F., Schramowski, P., Rothkopf, C. A., & Kersting, K. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314267 · Cited by 58
Theory In, Theory Out: The Uses of Social Theory in Machine Learning for Social Science
Radford, J., & Joseph, K. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00018 · Cited by 58
Zhang, G., Bai, B., Zhang, J., Bai, K., Zhu, C., & Zhao, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.380 · Cited by 65
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
Singhal, M., Ling, C., Paudel, P., Thota, P., Kumarswamy, N., Stringhini, G., & Nilizadeh, S. (2023) · 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp57164.2023.00056 · Cited by 57
Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning
Liu, H., Wang, W., Wang, Y., Liu, H., Liu, Z., & Tang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.64 · Cited by 57
Hindi-English Hate Speech Detection: Author Profiling, Debiasing, and Practical Perspectives
Chopra, S., Sawhney, R., Mathur, P., & Shah, R. R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5374 · Cited by 57
Training individually fair ML models with Sensitive Subspace RobustnessPreprint
Yurochkin, M., Bower, A., & Sun, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00020 · Cited by 90
Protein language models are biased by unequal sequence sampling across the tree of life
Ding, F., & Steinhardt, J. (2024) · doi:10.1101/2024.03.07.584001 · Cited by 57
An annotated dataset of literary entities
Bamman, D., Popat, S., & Shen, S. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1220 · Cited by 60
The Legal Status Of Artificial Intelligence And The Violation Of Human Rights
Nuredin, A. (2023) · International Scientific Journal Sui Generis · doi:10.55843/sg2321007n · Cited by 58
Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-Based Recruitment
Peña, A., Serna, I., Morales, A., Fiérrez, J., Ortega, A., Sánchez, A. H., Saéz, M. A., & Ortega-García, J. (2023) · SN Computer Science · doi:10.1007/s42979-023-01733-0 · Cited by 72
Shrestha, Y. R., & Yang, Y. (2019) · Algorithms · doi:10.3390/a12090199 · Cited by 62
Mitigating Gender Bias in Machine Learning Data Sets
Leavy, S., Meaney, G., Wade, K., & Greene, D. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-52485-2_2 · Cited by 54
Tomalin, M., Byrne, B., Concannon, S. J., Saunders, D., & Ullmann, S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09583-1 · Cited by 58
Paradigm shifts: exploring AI's influence on qualitative inquiry and analysis
Williams, R. (2024) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2024.1331589 · Cited by 54
Lee, P., Fyffe, S., Son, M., Jia, Z., & Yao, Z. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09864-6 · Cited by 62
Mitigating Bias in Algorithmic Systems—A Fish-eye View
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2022) · ACM Computing Surveys · doi:10.1145/3527152 · Cited by 58
Forecasting sustainable development goals scores by 2030 using machine learning models
Chenary, K., Kalat, O. P., & Sharifi, A. (2024) · Sustainable Development · doi:10.1002/sd.3037 · Cited by 58
Wang, X., Wu, Y. C., Ji, X., & Fu, H. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1320277 · Cited by 81
Metadata
- Authors
- Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A.
- Affiliations
- Boston University (US)
- Microsoft Research New England (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1607.06520
- OpenAlex
- W2483215953
- Cited by
- 1,615
- References
- 33
- Citations by year
- 2026: 17 · 2025: 136 · 2024: 201 · 2023: 240 · 2022: 154 · 2021: 313 · 2020: 253 · 2019: 204 · 2018: 69 · 2017: 26 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- OpenBU (Boston University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- gender bias, word embeddings, bias mitigation, gender stereotypes, gender neutrality, analogy tasks, concept clustering, Google News, crowdsourced evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
