CoChat
Sign Up
PreprintCited by 3

Bias in Large Language Models: Origin, Evaluation, and Mitigation

Guo, Yufei, Guo, Muzhe, Su, Juntao, Yang, Zhou, Zhu, Mengqiu, Li, Hongfei, Qiu, Mengyang, Liu, Shuo Shuo·2024·arXiv
DOI 10.48550/arxiv.2411.10915arXiv 2411.10915

Preprint — published as 10.3390/electronics15091824

Open this paper in CoChat — free account

Abstract

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current mitigation strategies. We categorize biases as intrinsic and extrinsic, analyzing their manifestations in various NLP tasks. The review critically assesses a range of bias evaluation methods, including data-level, model-level, and output-level approaches, providing researchers with a robust toolkit for bias detection. We further explore mitigation strategies, categorizing them into pre-model, intra-model, and post-model techniques, highlighting their effectiveness and limitations. Ethical and legal implications of biased LLMs are discussed, emphasizing potential harms in real-world applications such as healthcare and criminal justice. By synthesizing current knowledge on bias in LLMs, this review contributes to the ongoing effort to develop fair and responsible AI systems. Our work serves as a comprehensive resource for researchers and practitioners working towards understanding, evaluating, and mitigating bias in LLMs, fostering the development of more equitable AI technologies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2411.10915

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Several studies have documented that unfairness in LLM outputs can propagate discrimination and harm marginalized groups, particularly in domains like healthcare, law, and education.

    “Several studies have documented that unfairness in LLM outputs can propagate discrimination and harm marginalized groups, particularly in domains like healthcare, law, and education [11], [26].”

    From Trustworthiness Evaluation of Large Language Models Using Multi-Criteria Decision Making (2025) · cites this paper as [11]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 192

  1. Tariq Abdullah and Ahmed Ahmet. Deep learning in sentiment analysis: Recent architectures. ACM Computing Surveys, 55(8):1-37, 2022.
  2. Abubakar Abid, Maheen Farooqi, and James Zou. Persistent anti-muslim bias in large language models. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, page 298-306, New York, NY, USA, 2021. Association for Computing Machinery.
  3. Jaimeen Ahn and Alice Oh. Mitigating language-dependent ethnic bias in BERT. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics.
  4. Hirotugu Akaike. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6):716-723, 1974. doi: 10.1109/TAC.1974.1100705. · DOI · Paper page
  5. AJ Alvero, Jinsook Lee, Alejandra Regla-Vargas, Rene Kizilec, Thorsten Joachims, and Anthony Lis- ing Antonio. Large language models, social demography, and hegemony: Comparing authorship in human and synthetic text. Preprint, pages 1-25, 2024.
  6. Haozhe An, Christabel Acquaye, Colin Wang, Zongxia Li, and Rachel Rudinger. Do large language models discriminate in hiring decisions on the basis of race, ethnicity, and gender? arXiv preprint arXiv:2406.10486, 2024. · arXiv
  7. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. Machine bias. ProPublica, 23(2016): 139-159, 2016.
  8. Ron Artstein. Inter-annotator agreement. Handbook of linguistic annotation, pages 297-313, 2017.
  9. William Babonnaud, Estelle Delouche, and Mounir Lahlouh. The bias that lies beneath: Qualitative uncovering of stereotypes in large language models. Swedish Artificial Intelligence Society, pages 195-203, 2024.
  10. Yanhong Bai, Jiabao Zhao, Jinxin Shi, Zhentao Xie, Xingjiao Wu, and Liang He. Fairmonitor: A dual-framework for detecting stereotypes and biases in large language models. arXiv preprint arXiv:2405.03098, 2024. · arXiv
  11. Pragyan Banerjee, Abhinav Java, Surgan Jandial, Simra Shahid, Shaz Furniturewala, Balaji Krish- namurthy, and Sumit Bhatia. All should be equal in the eyes of lms: Counterfactually aware fair text generation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 17673-17681, 2024.
  12. Soumya Barikeri, Anne Lauscher, Ivan Vulić, and Goran Glavaš. RedditBias: A real-world resource for bias evaluation and debiasing of conversational language models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Online, August 2021. As- sociation for Computational Linguistics.
  13. Christine Basta, Marta R Costa-Jussà, and Noe Casas. Evaluating the underlying gender bias in contextualized word embeddings. arXiv preprint arXiv:1904.08783, 2019. · arXiv
  14. Emily M Bender and Batya Friedman. Data statements for natural language processing: Toward mitigating system bias and enabling better science. Transactions of the Association for Compu- tational Linguistics, 6:587-604, 2018.
  15. Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. On the dangers of stochastic parrots: Can language models be too big. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pages 610-623, 2021.
  16. Asia J Biega, Krishna P Gummadi, and Gerhard Weikum. Equity of attention: Amortizing individ- ual fairness in rankings. In The 41st international acm sigir conference on research & development in information retrieval, pages 405-414, 2018.
  17. Abeba Birhane and Vinay Uday Prabhu. Large image datasets: A pyrrhic win for computer vision? In 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 1536-1546. IEEE, 2021.
  18. Su Lin Blodgett and Brendan O'Connor. Racial disparity in natural language processing: A case study of social media african-american english. arXiv preprint arXiv:1707.00061, 2017. · arXiv
  19. Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. Language (technology) is power: A critical survey of "bias" in NLP. In Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel Tetreault, editors, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454-5476. Association for Computational Linguistics, 2020.
  20. Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. Advances in neural information processing systems, 29, 2016.
  21. Shikha Bordia and Samuel R. Bowman. Identifying and reducing gender bias in word-level language models. In North American Chapter of the Association for Computational Linguistics, 2019.
  22. Samuel R Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. A large anno- tated corpus for learning natural language inference. arXiv preprint arXiv:1508.05326, 2015. · arXiv
  23. Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in Neural Information Processing Systems, 33:1877-1901, 2020.
  24. Robin Burke, Nasim Sonboli, and Aldo Ordonez-Gauger. Balanced neighborhoods for multi-sided fairness in recommendation. In Conference on fairness, accountability and transparency, pages 202-214. PMLR, 2018.
  25. Pete Burnap and Matthew L Williams. Cyber hate speech on twitter: An application of machine classification and statistical modeling for policy and decision making. Policy & internet, 7(2): 223-242, 2015.
  26. Janga Bussaja. Evaluating racial bias in large language models: The necessity for. Available at SSRN 4880025, 2024.
  27. Yuchen Cai, Ding Cao, Rongxi Guo, Yaqin Wen, Guiquan Liu, and Enhong Chen. Locating and mitigating gender bias in large language models. In International Conference on Intelligent Com- puting, pages 471-482. Springer, 2024.
  28. Aylin Caliskan, Joanna J Bryson, and Arvind Narayanan. Semantics derived automatically from language corpora contain human-like biases. Science, 356(6334):183-186, 2017.
  29. Daniel Cer, Mona Diab, Eneko Agirre, Inigo Lopez-Gazpio, and Lucia Specia. Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation. arXiv preprint arXiv:1708.00055, 2017. · arXiv
  30. Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, et al. A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology, 15(3):1-45, 2024.
  31. Michelle Chen, Zhu Ma, Aniko Hannak, and Christo Wilson. My fair lady: Detecting and mitigating bias in job advertisements. Proceedings of the 2018 World Wide Web Conference, pages 991-1000, 2018.
  32. Qian Chen, Xiaodan Zhu, Zhenhua Ling, Si Wei, Hui Jiang, and Diana Inkpen. Enhanced lstm for natural language inference. arXiv preprint arXiv:1609.06038, 2016. · arXiv
  33. Ruey-Cheng Chen, Qingyao Ai, Gaya Jayasinghe, and W Bruce Croft. Correcting for recency bias in job recommendation. In Proceedings of the 28th ACM international conference on information and knowledge management, pages 2185-2188, 2019.
  34. Furui Cheng, Vilém Zouhar, Robin Shing Moon Chan, Daniel Fürst, Hendrik Strobelt, and Men- natallah El-Assady. Interactive analysis of llms using meaningful counterfactuals. arXiv preprint arXiv:2405.00708, 2024. · arXiv
  35. Richárd Csáky, Patrik Purgai, and Gábor Recski. Improving neural conversational models with entropy-based data filtering. arXiv preprint arXiv:1905.05471, 2019. · arXiv
  36. Yifei Da, Matías Nicolás Bossa, Abel Díaz Berenguer, and Hichem Sahli. Reducing bias in sentiment analysis models through causal mediation analysis and targeted counterfactual training. IEEE Access, 2024.
  37. Vu Minh Hoang Dang and Rakesh M Verma. Data quality in nlp: Metrics and a comprehensive taxonomy. In International Symposium on Intelligent Data Analysis, pages 217-229. Springer, 2024.
  38. Debarati Das, Karin De Langis, Anna Martin, Jaehyung Kim, Minhwa Lee, Zae Myung Kim, Shirley Hayati, Risako Owan, Bin Hu, Ritik Parkar, et al. Under the surface: Tracking the artifactuality of llm-generated data. arXiv preprint arXiv:2401.14698, 2024. · arXiv
  39. Maria De-Arteaga, Alexey Romanov, Hanna Wallach, Jennifer Chayes, Christian Borgs, Alexandra Chouldechova, Sahin Geyik, Krishnaram Kenthapadi, and Adam Tauman Kalai. Bias in bios: A case study of semantic representation bias in a high-stakes setting. In proceedings of the Conference on Fairness, Accountability, and Transparency, pages 120-128, 2019.
  40. Jader Martins Camboim de Sá, Marcos Da Silveira, and Cédric Pruski. Semantic change character- ization with llms using rhetorics. arXiv preprint arXiv:2407.16624, 2024. · arXiv
  41. Daniel de Vassimon Manela, David Errington, Thomas Fisher, Boris van Breugel, and Pasquale Minervini. Stereotype and skew: Quantifying gender bias in pre-trained and fine-tuned language models. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 2232-2242, 2021.
  42. Pieter Delobelle and Bettina Berendt. Fairdistillation: mitigating stereotyping in language models. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pages 638-654. Springer, 2022.
  43. Sunipa Dev, Tao Li, Jeff M Phillips, and Vivek Srikumar. On measuring and mitigating biased inferences of word embeddings. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 7659-7666, 2020.
  44. Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, et al. On measures of biases and harms in nlp. arXiv preprint arXiv:2108.03362, 2021. · arXiv
  45. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018. · arXiv
  46. Fernando Diaz, Bhaskar Mitra, and Nick Craswell. Query expansion with locally-trained word embeddings. arXiv preprint arXiv:1605.07891, 2016. · arXiv
  47. Mark Díaz, Isaac Johnson, Amanda Lazar, Anne Marie Piper, and Darren Gergle. Addressing age- related bias in sentiment analysis. In Proceedings of the 2018 chi conference on human factors in computing systems, pages 1-14, 2018.
  48. Thang Viet Doan, Zichong Wang, Minh Nhat Nguyen, and Wenbin Zhang. Fairness in large language models in three hours. In Proceedings of the 33rd ACM International Conference on Information & Knowledge Management (Boise, USA), 2024.
  49. Matthew Durward and Christopher Thomson. Evaluating vocabulary usage in llms. In Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024), pages 266-282, 2024.
  50. Satyam Dwivedi, Sanjukta Ghosh, and Shivam Dwivedi. Breaking the bias: Gender fairness in llms using prompt engineering and in-context learning. Rupkatha Journal on Interdisciplinary Studies in Humanities, 15(4), 2023.
  51. Jessica Echterhoff, Yao Liu, Abeer Alessa, Julian McAuley, and Zexue He. Cognitive bias in high- stakes decision-making with llms. arXiv preprint arXiv:2403.00811, 2024. · arXiv
  52. Michael D Ekstrand, Mucun Tian, Ion Madrazo Azpiazu, Jennifer D Ekstrand, Oghenemaro Anuyah, David McNeill, and Maria Soledad Pera. All the cool kids, how do they fit in?: Popularity and demographic biases in recommender evaluation and effectiveness. In Conference on fairness, accountability and transparency, pages 172-186. PMLR, 2018.
  53. David Esiobu, Xiaoqing Tan, Saghar Hosseini, Megan Ung, Yuchen Zhang, Jude Fernandes, Jane Dwivedi-Yu, Eleonora Presani, Adina Williams, and Eric Smith. Robbie: Robust bias evaluation of large generative language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3764-3814, 2023.
  54. Emilio Ferrara. Should chatgpt be biased? challenges and risks of bias in large language models. First Mondy, 28(11), 2023.
  55. Isabel O Gallegos, Ryan A Rossi, Joe Barrow, Md Mehrab Tanjim, Sungchul Kim, Franck Dernon- court, Tong Yu, Ruiyi Zhang, and Nesreen K Ahmed. Bias and fairness in large language models: A survey. Computational Linguistics, pages 1-79, 2024.
  56. Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. Allennlp: A deep semantic natural language processing platform. arXiv preprint arXiv:1803.07640, 2018. · arXiv
  57. Nikhil Garg, Londa Schiebinger, Dan Jurafsky, and James Zou. Word embeddings quantify 100 years of gender and ethnic stereotypes. Proceedings of the National Academy of Sciences, 115(16): E3635-E3644, 2018.
  58. Aparna Garimella, Akhash Amarnath, Kiran Kumar, Akash Pramod Yalla, N Anandhavelu, Niyati Chhaya, and Balaji Vasan Srinivasan. He is very intelligent, she is very beautiful? on mitigating social biases in language modelling and generation. In Findings of the Association for Computa- tional Linguistics: ACL-IJCNLP 2021, pages 4534-4545, 2021.
  59. Aparna Garimella, Rada Mihalcea, and Akhash Amarnath. Demographic-aware language model fine-tuning as a bias mitigation technique. In Proceedings of the 2nd Conference of the Asia- Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 311-319, 2022.
  60. Yingqiang Ge, Wenyue Hua, Kai Mei, Juntao Tan, Shuyuan Xu, Zelong Li, Yongfeng Zhang, et al. Openagi: When llm meets domain experts. Advances in Neural Information Processing Systems, 36, 2024.
  61. Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé Iii, and Kate Crawford. Datasheets for datasets. Communications of the ACM, 64 (12):86-92, 2021.
  62. Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. RealToxici- tyPrompts: Evaluating neural toxic degeneration in language models. In Trevor Cohn, Yulan He, and Yang Liu, editors, Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3356-3369. Association for Computational Linguistics, 2020.
  63. Josh Goldman and John K Tsotsos. Statistical challenges with dataset construction: Why you will never have enough images. arXiv preprint arXiv:2408.11160, 2024. · arXiv
  64. Atmika Gorti, Manas Gaur, and Aman Chadha. Unboxing occupational bias: Grounded debiasing llms with us labor data. arXiv preprint arXiv:2408.11247, 2024. · arXiv
  65. Md Rakibul Hasan, Maisha Maliha, and M Arifuzzaman. Sentiment analysis with nlp on twitter data. In 2019 international conference on computer, communication, chemical, materials and electronic engineering (IC4ME2), pages 1-4. IEEE, 2019.
  66. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Science & Business Media, 2nd edition, 2009. URL https://doi.org/10.1007/978-0-387-84858-7. · DOI · Paper page
  67. Lucy Havens, Melissa Terras, Benjamin Bach, and Beatrice Alex. Uncertainty and inclusivity in gender bias annotation: An annotation taxonomy and annotated datasets of british english text. In 4th Workshop on Gender Bias in Natural Language Processing at NAACL, pages 30-57. ACL Anthology, 2022.
  68. James J. Heckman. Sample selection bias as a specification error. Econometrica, 47(1):153-161, 1979. doi: 10.2307/1912352. URL https://www.jstor.org/stable/1912352. · DOI · Paper page
  69. Lisa Anne Hendricks, Kaylee Burns, Kate Saenko, Trevor Darrell, and Anna Rohrbach. Women also snowboard: Overcoming bias in captioning models. In Proceedings of the European conference on computer vision (ECCV), pages 771-787, 2018.
  70. John Hewitt and Christopher D Manning. A structural probe for finding syntax in word representa- tions. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, pages 4129-4138, 2019.
  71. Günter J Hitsch, Ali Hortaçsu, and Dan Ariely. Matching and sorting in online dating. American Economic Review, 100(1):130-163, 2010.
  72. Chuan Tian Hongfei Li, Qian H. Li and Kevin Hou. Issues in cox proportional hazards model with unequal randomization. Journal of Biopharmaceutical Statistics, 0(0):1-6, 2024a. doi: 10.1080/ 10543406.2024.2418139. URL https://doi.org/10.1080/10543406.2024.2418139. PMID: 39445665. · DOI
  73. Chuan Tian Hongfei Li, Qian H. Li and Kevin Hou. Issues in cox proportional hazards model with unequal randomization. Journal of Biopharmaceutical Statistics, 0(0):1-6, 2024b. doi: 10.1080/ 10543406.2024.2418139. URL https://doi.org/10.1080/10543406.2024.2418139. PMID: 39445665. · DOI
  74. Dirk Hovy and Shrimai Prabhumoye. Five sources of bias in natural language processing. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, pages 878-888, 2021.
  75. Dirk Hovy and Anders Søgaard. Tagging performance correlates with author age. In Proceedings of the 53rd annual meeting of the Association for Computational Linguistics and the 7th international joint conference on natural language processing (volume 2: Short papers), pages 483-488, 2015.
  76. Dirk Hovy and Shannon L Spruit. The social impact of natural language processing. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 591-598, 2016.
  77. Dirk Hovy and Diyi Yang. The importance of modeling social factors of language: Theory and practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human language technologies, pages 588-602, 2021.
  78. Zhanhao Hu, Julien Piet, Geng Zhao, Jiantao Jiao, and David Wagner. Toxicity detection for free. arXiv preprint arXiv:2405.18822, 2024. · arXiv
  79. Wenyue Hua, Yingqiang Ge, Shuyuan Xu, Jianchao Ji, and Yongfeng Zhang. Up5: Unbiased foun- dation model for fairness-aware recommendation. arXiv preprint arXiv:2305.12090, 2023. · arXiv
  80. Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, et al. Llama guard: Llm-based input-output safeguard for human-ai conversations. arXiv preprint arXiv:2312.06674, 2023. · arXiv
  81. Liying Jiang, Ming Yang, and Xiang Li. Smart music player: User-adaptive music recommendation system. IEEE Transactions on Multimedia, 22(3):666-675, 2020.
  82. Przemyslaw Joniak and Akiko Aizawa. Gender biases and where to find them: Exploring gender bias in pre-trained transformer-based language models using movement pruning. In Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP), Seattle, Washington, July 2022. Association for Computational Linguistics.
  83. Ashraf Kamal, Tarique Anwar, Vineet Kumar Sejwal, and Mohd Fazil. Bicapshate: attention to the linguistic context of hate via bidirectional capsules and hatebase. IEEE Transactions on Computational Social Systems, 11(2):1781-1792, 2023.
  84. Mozhgan Karimi, Dietmar Jannach, and Michael Jugovac. News recommender systems-survey and roads ahead. Information Processing & Management, 54(6):1203-1227, 2018.
  85. Nitish Shirish Keskar, Bryan McCann, Lav R Varshney, Caiming Xiong, and Richard Socher. Ctrl: A conditional transformer language model for controllable generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, pages 111-129, 2019.
  86. Simran Khanuja, Sebastian Ruder, and Partha Talukdar. Evaluating the diversity, equity and inclusion of nlp technology: A case study for indian languages. arXiv preprint arXiv:2205.12676, 2022. · arXiv
  87. Svetlana Kiritchenko and Saif M Mohammad. Examining gender and race bias in two hundred sentiment analysis systems. arXiv preprint arXiv:1805.04508, 2018. · arXiv
  88. Allison Koenecke, Andrew Nam, Emily Lake, Joe Nudell, Minnie Quartey, Zion Mengesha, Connor Toups, John R Rickford, Dan Jurafsky, and Sharad Goel. Racial disparities in automated speech recognition. Proceedings of the national academy of sciences, 117(14):7684-7689, 2020.
  89. Hyukhun Koh, Dohyung Kim, Minwoo Lee, and Kyomin Jung. Can llms recognize toxic- ity? structured toxicity investigation framework and semantic-based metric. arXiv preprint arXiv:2402.06900, 2024. · arXiv
  90. Hadas Kotek, Rikker Dockum, and David Sun. Gender bias and stereotypes in large language models. In Proceedings of the ACM collective intelligence conference, pages 12-24, 2023.
  91. Keita Kurita, Nidhi Vyas, Ayush Pareek, Alan W Black, and Yulia Tsvetkov. Measuring bias in contextualized word representations. arXiv preprint arXiv:1906.07337, 2019. · arXiv
  92. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics, 7:453-466, 2019.
  93. Surafel M Lakew, Marcello Federico, Matteo Negri, and Marco Turchi. Multilingual neural machine translation for low-resource languages. IJCoL. Italian Journal of Computational Linguistics, 4 (4-1):11-25, 2018.
  94. Byunghwee Lee, Rachith Aiyappa, Yong-Yeol Ahn, Haewoon Kwak, and Jisun An. Neural embed- ding of beliefs reveals the role of relative dissonance in human decision-making. arXiv preprint arXiv:2408.07237, 2024. · arXiv
  95. Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. End-to-end neural coreference resolution. arXiv preprint arXiv:1707.07045, 2017. · arXiv
  96. Sharon Levy, Neha John, Ling Liu, Yogarshi Vyas, Jie Ma, Yoshinari Fujinuma, Miguel Ballesteros, Vittorio Castelli, and Dan Roth. Comparing biases and the impact of multilingual training across multiple languages. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore, December 2023. Association for Computational Linguistics.
  97. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7871-7880, 2020.
  98. Jingling Li, Zeyu Tang, Xiaoyu Liu, Peter Spirtes, Kun Zhang, Liu Leqi, and Yang Liu. Steer- ing llms towards unbiased responses: A causality-guided debiasing framework. arXiv preprint arXiv:2403.08743, 2024a. · arXiv
  99. Weitao Li, Junkai Li, Weizhi Ma, and Yang Liu. Citation-enhanced generation for llm-based chatbot. arXiv preprint arXiv:2402.16063, 2024b. · arXiv
  100. Yingji Li, Mengnan Du, Rui Song, Xin Wang, and Ying Wang. A survey on fairness in large language models. arXiv preprint arXiv:2308.10149, 2023. · arXiv
  101. Paul Pu Liang, Irene Mengze Li, Emily Zheng, Yao Chong Lim, Ruslan Salakhutdinov, and Louis- Philippe Morency. Towards debiasing sentence representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, July 2020a. Association for Computational Linguistics.
  102. Paul Pu Liang, Liang Zheng, Ruslan Salakhutdinov, and Louis-Philippe Morency. Towards debias- ing sentence representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5502-5515, 2020b.
  103. Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, and Ruslan Salakhutdinov. Towards under- standing and mitigating social biases in language models. In International Conference on Machine Learning, pages 6565-6576. PMLR, 2021.
  104. Zichao Lin, Shuyan Guan, Wending Zhang, Huiyan Zhang, Yugang Li, and Huaping Zhang. Towards trustworthy llms: a review on debiasing and dehallucinating in large language models. Artificial Intelligence Review, 57(9):1-50, 2024.
  105. Ruibo Liu, Chenyan Jia, Jason Wei, Guangxuan Xu, Lili Wang, and Soroush Vosoughi. Mitigating political bias in language models through reinforced calibration. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 14857-14866, 2021.
  106. Shuo Shuo Liu. Unified transfer learning in high-dimensional linear regression. In International Conference on Artificial Intelligence and Statistics, pages 1036-1044. PMLR, 2024.
  107. Penny Mackieson, Aron Shlonsky, and Marie Connolly. Increasing rigor and reducing bias in qual- itative research: A document analysis of parliamentary debates using applied thematic analysis. Qualitative social work, 18(6):965-980, 2019.
  108. Rowan Hall Maudslay, Hila Gonen, Ryan Cotterell, and Simone Teufel. It's all in the name: Mitigating gender bias with name-based counterfactual data substitution. In Conference on Empirical Methods in Natural Language Processing, 2019. URL https://api.semanticscholar.org/CorpusID:202541569.
  109. Chandler May, Alex Wang, Shikha Bordia, Samuel R Bowman, and Rachel Rudinger. On measuring social biases in sentence encoders. arXiv preprint arXiv:1903.10561, 2019. · arXiv
  110. Nicholas Meade, Elinor Poole-Dayan, and Siva Reddy. An empirical survey of the effectiveness of debiasing techniques for pre-trained language models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1878-1898, Dublin, Ireland, May 2022. Association for Computational Linguistics.
  111. Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. A survey on bias and fairness in machine learning. ACM Computing Surveys, 54(6):1-35, 2021.
  112. Yu Meng, Yunyi Zhang, Jiaxin Huang, Chenyan Xiong, Heng Ji, Chao Zhang, and Jiawei Han. Text classification using label names only: A language model self-training approach. arXiv preprint arXiv:2010.07245, 2020. · arXiv
  113. Karolis Misiunas and Ulrich F Keyser. Density-dependent speed-up of particle transport in channels. Physical Review Letters, 122(21):214501, 2019.
  114. Devam Mondal and Carlo Lipizzi. Mitigating large language model bias: Automated dataset aug- mentation and prejudice quantification. Computers, 13(6):141, 2024.
  115. Edoardo Mosca, Ferenc Szigeti, Stella Tragianni, Daniel Gallagher, and Georg Groh. Shap-based explanation methods: a review for nlp interpretability. In Proceedings of the 29th international conference on computational linguistics, pages 4593-4603, 2022.
  116. Anjishnu Mukherjee, Aylin Caliskan, Ziwei Zhu, and Antonios Anastasopoulos. Global gallery: The fine art of painting culture portraits through multilingual instruction tuning. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6398-6415, 2024.
  117. Moin Nadeem, Anna Bethke, and Siva Reddy. Stereoset: Measuring stereotypical bias in pretrained language models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, pages 5356-5371, 2021.
  118. Ramesh Nallapati, Bowen Zhou, Caglar Gulcehre, Bing Xiang, et al. Abstractive text summarization using sequence-to-sequence rnns and beyond. arXiv preprint arXiv:1602.06023, 2016. · arXiv
  119. Roberto Navigli, Simone Conia, and Björn Ross. Biases in large language models: Origins, inventory, and discussion. J. Data and Information Quality, 15(2), 2023.
  120. Szilard Nemes, Junmei M. Jonasson, Anna Genell, and Gunnar Steineck. Bias in odds ratios by logistic regression modelling and sample size. BMC Med- ical Research Methodology, 9:56, 2009. doi: 10.1186/1471-2288-9-56. URL https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-9-56. · DOI · Paper page
  121. Davide Neri, Jacopo Soldani, Olaf Zimmermann, and Antonio Brogi. Design principles, architectural smells and refactorings for microservices: a multivocal review. SICS Software-Intensive Cyber- Physical Systems, 35:3-15, 2020.
  122. Shangrui Nie, Michael Fromm, Charles Welch, Rebekka Görge, Akbar Karimi, Joan Plepi, Nazia Mowmita, Nicolas Flores-Herr, Mehdi Ali, and Lucie Flek. Do multilingual large language models mitigate stereotype bias? In Proceedings of the 2nd Workshop on Cross-Cultural Considerations in NLP, Bangkok, Thailand, August 2024a. Association for Computational Linguistics.
  123. Shangrui Nie, Michael Fromm, Charles Welch, Rebekka Görge, Akbar Karimi, Joan Plepi, Nazia Af- san Mowmita, Nicolas Flores-Herr, Mehdi Ali, and Lucie Flek. Do multilingual large language models mitigate stereotype bias? arXiv preprint arXiv:2407.05740, 2024b. · arXiv
  124. Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464):447-453, 2019.
  125. Collins W Okonkwo and Abejide Ade-Ibijola. The role of artificial intelligence in education: Prospects and challenges. Journal of Educational Technology & Society, 26(1):1-12, 2023.
  126. Jahna Otterbacher, Jo Bates, and Paul Clough. Competent men and warm women: Gender stereo- types and backlash in image search results. In Proceedings of the 2017 chi conference on human factors in computing systems, pages 6620-6631, 2017.
  127. Tiago P Pagano, Rafael B Loureiro, Fernanda VN Lisboa, Rodrigo M Peixoto, Guilherme AS Guimarães, Gustavo OR Cruz, Maira M Araujo, Lucas L Santos, Marco AS Cruz, Ewerton LS Oliveira, et al. Bias and unfairness in machine learning models: a systematic review on datasets, tools, fairness metrics, and identification and mitigation methods. Big data and cognitive comput- ing, 7(1):15, 2023.
  128. Bo Pang, Lillian Lee, et al. Opinion mining and sentiment analysis. Foundations and Trends® in information retrieval, 2(1-2):1-135, 2008.
  129. Eli Pariser. The Filter Bubble: How the New Personalized Web is Changing What We Read and How We Think. Penguin, 2011.
  130. Ji Ho Park, Jamin Shin, and Pascale Fung. Reducing gender bias in abusive language detection. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October-November 2018. Association for Computational Linguistics.
  131. Silviu Paun, Ron Artstein, and Massimo Poesio. Statistical methods for annotation analysis. Springer Nature, 2022.
  132. Judea Pearl, Madelyn Glymour, and Nicholas P Jewell. Causal inference in statistics: A primer. John Wiley & Sons, 2016.
  133. Laura Perez-Beltrachini and Mirella Lapata. Models and datasets for cross-lingual summarisation. arXiv preprint arXiv:2202.09583, 2022. · arXiv
  134. Yusu Qian, Urwa Muaz, Ben Zhang, and Jae Won Hyun. Reducing gender bias in word-level language models with a gender-equalizing loss function. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, Florence, Italy, July 2019. Association for Computational Linguistics.
  135. Yao Qu and Jue Wang. Performance and biases of large language models in public opinion simulation. Humanities and Social Sciences Communications, 11(1):1-13, 2024.
  136. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.
  137. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21:1-67, 2020.
  138. Alvin Rajkomar, Moritz Hardt, Michael D Howell, Greg Corrado, and Michael H Chin. Ensuring fairness in machine learning to advance health equity. Annals of Internal Medicine, 169(12): 866-872, 2018.
  139. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. Squad: 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250, 2016. · arXiv
  140. Pranav Rajpurkar, Robin Jia, and Percy Liang. Know what you don't know: Unanswerable questions for squad. arXiv preprint arXiv:1806.03822, 2018. · arXiv
  141. Shauli Ravfogel, Yanai Elazar, Hila Gonen, Michael Twiton, and Yoav Goldberg. Null it out: Guard- ing protected attributes by iterative nullspace projection. In Proceedings of the 58th Annual Meet- ing of the Association for Computational Linguistics, Online, July 2020. Association for Compu- tational Linguistics.
  142. Partha Pratim Ray. Chatgpt: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3: 121-154, 2023.
  143. David Rozado. The political preferences of llms. PloS one, 19(7):e0306621, 2024.
  144. Donald B. Rubin. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5):688-701, 1974. doi: 10.1037/h0037350. · DOI · Paper page
  145. Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. Gender bias in coreference resolution. arXiv preprint arXiv:1804.09301, 2018. · arXiv
  146. Abel Salinas, Louis Penafiel, Robert McCormack, and Fred Morstatter. " im not racist but...": Dis- covering bias in the internal knowledge of large language models. arXiv preprint arXiv:2310.08780, 2023. · arXiv
  147. Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A Smith. The risk of racial bias in hate speech detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1668-1678, 2019a.
  148. Maarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky, Noah A Smith, and Yejin Choi. Social bias frames: Reasoning about social and power implications of language. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5477-5483, 2019b.
  149. Danielle Saunders and Bill Byrne. Reducing gender bias in neural machine translation as a domain adaptation problem. In Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel Tetreault, editors, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7724-7736. Association for Computational Linguistics, 2020.
  150. Akrati Saxena, Harita Reddy, and Pratishtha Saxena. Introduction to sentiment analysis covering basics, tools, evaluation metrics, challenges, and applications. Principles of social networking: the new horizon and emerging challenges, pages 249-277, 2022.
  151. Nino Scherrer, Claudia Shi, Amir Feder, and David Blei. Evaluating the moral beliefs encoded in llms. Advances in Neural Information Processing Systems, 36, 2024.
  152. Timo Schick, Sahana Udupa, and Hinrich Schütze. Self-diagnosis and self-debiasing: A proposal for reducing corpus-based bias in nlp. Transactions of the Association for Computational Linguistics, 9:1408-1424, 2021.
  153. Ibrahim Mohamed Serouis and Florence Sèdes. Exploring large language models for bias mitigation and fairness. In 1st International Workshop on AI Governance (AIGOV) in conjunction with the Thirty-Third International Joint Conference on Artificial Intelligence, 2024.
  154. Tianxiao Shen, Tao Lei, Regina Barzilay, and Tommi Jaakkola. Style transfer from non-parallel text by cross-alignment. Advances in neural information processing systems, 30, 2017.
  155. Zhiqiang Shen, Tianhua Tao, Liqun Ma, Willie Neiswanger, Joel Hestness, Natalia Vassilieva, Daria Soboleva, and Eric Xing. Slimpajama-dc: Understanding data combinations for llm training. arXiv preprint arXiv:2309.10818, 2023. · arXiv
  156. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. The woman worked as a babysit- ter: On biases in language generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3407-3412, 2019.
  157. Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, and Nanyun Peng. Societal biases in language generation: Progress and challenges. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, pages 4275-4293, 2021.
  158. Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Raya Horesh, Rogério Abreu de Paula, Diyi Yang, et al. Culturebank: An online community-driven knowledge base towards culturally aware language technologies. arXiv preprint arXiv:2404.15238, 2024. · arXiv
  159. Leandro Silva, Mainack Mondal, Denzil Correa, Fabrício Benevenuto, and Ingmar Weber. Analyzing the targets of hate in online social media. In Proceedings of the International AAAI Conference on Web and Social Media, volume 10, pages 687-690, 2016.
  160. Gabriel Simmons and Christopher Hare. Large language models as subpopulation representative models: A review. arXiv preprint arXiv:2310.17888, 2023. · arXiv
  161. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1):1929-1958, 2014.
  162. Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, and William Yang Wang. Mitigating gender bias in natural language processing: Literature review. arXiv preprint arXiv:1906.08976, 2019. · arXiv
  163. Zeerak Talat, Aurélie Névéol, Stella Biderman, Miruna Clinciu, Manan Dey, Shayne Longpre, Sasha Luccioni, Maraim Masoud, Margaret Mitchell, Dragomir Radev, et al. You reap what you sow: On the challenges of bias evaluation under multilingual settings. In Proceedings of BigScience Episode# 5-Workshop on Challenges & Perspectives in Creating Large Language Models, pages 26-41, 2022.
  164. Liling Tan and Francis Bond. Building and annotating the linguistically diverse ntu-mc (ntu- multilingual corpus). In Proceedings of the 25th Pacific Asia Conference on Language, Information and Computation, pages 362-371. Waseda University, 2011.
  165. Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1):267-288, 1996.
  166. Eva Vanmassenhove, Dimitar Shterionov, and Andy Way. Lost in translation: Loss and decay of linguistic richness in machine translation. arXiv preprint arXiv:1906.12068, 2019. · arXiv
  167. Yehuda Vardi. Nonparametric estimation in the presence of length bias. The Annals of Statistics, 10(2):616-620, 1982. doi: 10.1214/aos/1176345802. URL https://projecteuclid.org/euclid.aos/1176345802. · DOI
  168. A Vaswani. Attention is all you need. Advances in Neural Information Processing Systems, 2017.
  169. Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, and Stuart Shieber. Investigating gender bias in language models using causal mediation analysis. Advances in Neural Information Processing Systems, 33:12388-12401, 2020.
  170. Ivan Vulic and Marie-Francine Moens. Cross-lingual semantic similarity of words as the similarity of their semantic word responses. In Proceedings of the 2013 Conference of the North Amer- ican Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2013), pages 106-116. ACL; East Stroudsburg, PA, 2013.
  171. Angelina Wang, Jamie Morgenstern, and John P Dickerson. Large language models cannot replace human participants because they cannot portray identity groups. arXiv preprint arXiv:2402.01908, 2024a. · arXiv
  172. Xinru Wang, Hannah Kim, Sajjadur Rahman, Kushan Mitra, and Zhengjie Miao. Human-llm collaborative annotation through effective verification of llm labels. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 1-21, 2024b.
  173. Zeyu Wang. Causalbench: A comprehensive benchmark for evaluating causal reasoning capabilities of large language models. In Proceedings of the 10th SIGHAN Workshop on Chinese Language Processing (SIGHAN-10), pages 143-151, 2024.
  174. Mayur Wankhade, Annavarapu Chandra Sekhara Rao, and Chaitanya Kulkarni. A survey on sen- timent analysis methods, applications, and challenges. Artificial Intelligence Review, 55(7):5731- 5780, 2022.
  175. Kellie Webster, Marta Recasens, Vera Axelrod, and Jason Baldridge. Mind the gap: A balanced corpus of gendered ambiguous pronouns. Transactions of the Association for Computational Lin- guistics, 6:605-617, 2018.
  176. Kellie Webster, Xuezhi Wang, Ian Tenney, Alex Beutel, Emily Pitler, Ellie Pavlick, Jilin Chen, Ed Chi, and Slav Petrov. Measuring and reducing gendered correlations in pre-trained models. arXiv preprint arXiv:2010.06032, 2020. · arXiv
  177. Cynthia M Whissell. The dictionary of affect in language. In The measurement of emotions, pages 113-131. Elsevier, 1989.
  178. Zekun Wu, Sahan Bulathwela, Maria Perez-Ortiz, and Adriano Soares Koshiyama. Auditing large language models for enhanced text-based stereotype detection and probing-based bias evaluation. arXiv preprint arXiv:2404.01768, 2024. · arXiv
  179. Yuqi Yang, Yuan Yuan, and Lei Liu. Finbert: A pretrained language model for financial communi- cations. arXiv preprint arXiv:2006.08097, 2020. · arXiv
  180. Travis Zack, Eric Lehman, Mirac Suzgun, and Jorge A Rodriguez. Assessing the potential of gpt-4 to perpetuate racial and gender biases in health care: a model evaluation study. The Lancet Digital Health, 6(1):E12-E22, 2024.
  181. Lotfi A Zadeh. From search engines to question answering systems-the problems of world knowledge, relevance, deduction and precisiation. In Capturing intelligence, volume 1, pages 163-210. Elsevier, 2006.
  182. Congzhi Zhang, Linhai Zhang, Deyu Zhou, and Guoqiang Xu. Causal prompting: Debiasing large language model prompting based on front-door adjustment. arXiv preprint arXiv:2403.02738, 2024. · arXiv
  183. Lei Zhang, Shuai Wang, and Bing Liu. Deep learning for sentiment analysis: A survey. IEEE Transactions on Affective Computing, 10(3):235-255, 2018.
  184. Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR), 52(1):1-38, 2019a.
  185. Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and Bill Dolan. Dialogpt: Large-scale generative pre-training for conversational response generation. arXiv preprint arXiv:1911.00536, 2019b. · arXiv
  186. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv preprint arXiv:1707.09457, 2017. · arXiv
  187. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. Gender bias in coreference resolution: Evaluation and debiasing methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics, pages 15-20, 2018a.
  188. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. Learning gender- neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4847-4853, 2018b.
  189. Jieyu Zhao, Yichao Zhou, Zeyu Li, Wei Wang, and Kai-Wei Chang. Learning gender-neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October-November 2018c. Association for Computational Linguis- tics.
  190. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Ryan Cotterell, Vicente Ordonez, and Kai-Wei Chang. Gender bias in contextualized word embeddings. arXiv preprint arXiv:1904.03310, 2019. · arXiv
  191. Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan, Dongbo Xi, Yongchun Zhu, Hengshu Zhu, Hui Xiong, and Qing He. A comprehensive survey on transfer learning. Proceedings of the IEEE, 109(1):43-76, 2020.
  192. Ran Zmigrod, Sabrina J. Mielke, Hanna Wallach, and Ryan Cotterell. Counterfactual data augmen- tation for mitigating gender stereotypes in languages with rich morphology. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, July 2019. Association for Computational Linguistics.

Cited by

Sorted by citations

Authors
Guo, Y., Guo, M., Su, J., Yang, Z., Zhu, M., Li, H., Qiu, M., & Liu, S. S.
Venue
arXiv
Publisher
arXiv
Published
2024
DOI
10.48550/arxiv.2411.10915
arXiv
2411.10915
References
0
Type
Preprint
Licence
creativecommons.org/licenses/by/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review