The DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
Open accessAbstract
Warning: This paper contains explicit statements of offensive stereotypes and may be upsetting.Pretrained language models, especially masked language models (MLMs) have seen success across many NLP tasks.However, there is ample evidence that they use the cultural biases that are undoubtedly present in the corpora they are trained on, implicitly creating harm with biased representations.To measure some forms of social bias in language models against protected demographic groups in the US, we introduce the Crowdsourced Stereotype Pairs benchmark (CrowS-Pairs).CrowS-Pairs has 1508 examples that cover stereotypes dealing with nine types of bias, like race, religion, and age.In CrowS-Pairs a model is presented with two sentences: one that is more stereotyping and another that is less stereotyping.The data focuses on stereotypes about historically disadvantaged groups and contrasts them with advantaged groups.We find that all three of the widelyused MLMs we evaluate substantially favor sentences that express stereotypes in every category in CrowS-Pairs.As work on building less biased models advances, this dataset can be used as a benchmark to evaluate progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the literature, many works refer to the metric as the dataset, and use these interchangeably.”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Nangia et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each pair consists of one sentence demonstrating a stereotype, and the other sentence replacing the disadvantaged group with an advantaged one (”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Nangia et al. 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“InstructGPT does not significantly improve over GPT-3 on the Winogender (Rudinger et al., 2018) and CrowSPairs (Nangia et al., 2020) datasets.”
From Training language models to follow instructions with human feedback (2022) · cites this paper as Nangia et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“InstructGPT does not significantly improve over GPT-3 on the Winogender (Rudinger et al., 2018) and CrowSPairs (Nangia et al., 2020) datasets.”
From Training language models to follow instructions with human feedback (2022) · cites this paper as Nangia et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“One example is the CrowS-Pairs (Nangia et al. 2020) dataset consisting of stereotype sentence pairs proposed alongside a pseudo-log-likelihood metric over this specific set of sentence pairs:”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Nangia et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“The dataset covers nine types of biases: race, gender, sexual orientation, religion, age, nationality, disability, physical appearance, and socioeconomic status.”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Nangia et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“Crowdsourced Stereotype Pairs (CrowS-Pairs) (Nangia et al. 2020) provides 1,508 sentence pairs to evaluate stereotypes of historically disadvantaged social groups.”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Nangia et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342
Self-citationSemantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887
Zhu, Y., Kiros, R., Zemel, R., Salakhutdinov, R., Urtasun, R., Torralba, A., & Fidler, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.11 · Cited by 2,264
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Black sexual politics: African Americans, gender, and the new racism
(2005) · Choice Reviews Online · doi:10.5860/choice.42-3729 · Cited by 1,940
Research works printed but not linked: 6
- Emily Dinan, Angela Fan, Ledell Wu, Jason Weston, Douwe Kiela, and Adina Williams. 2020. Multi- dimensional gender bias classification. ArXiv.
- Paul Pu Liang, Irene Mengze Li, Emily Zheng, Yao Chong Lim, Ruslan Salakhutdinov, and Louis- Philippe Morency. 2020. Towards debiasing sen- tence representations. In Proceedings of the 2020 Association for Computational Linguistics. Associa- tion for Computational Linguistics.
- Alex Wang and Kyunghyun Cho. 2019. BERT has a mouth, and it must speak: BERT as a Markov random field language model. In Proceedings of the Workshop on Methods for Optimizing and Eval- uating Neural Language Generation, pages 30-36, Minneapolis, Minnesota. Association for Computa- tional Linguistics. · DOI
- Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2019. SuperGLUE: A stickier benchmark for general-purpose language un- derstanding systems. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d Álché Buc, E. Fox, and R. Gar- nett, editors, Advances in Neural Information Pro- cessing Systems 32, pages 3266-3280.
- Kellie Webster, Marta Recasens, Vera Axelrod, and Ja- son Baldridge. 2018. Mind the GAP: A balanced corpus of gendered ambiguous pronouns. Transac- tions of the Association for Computational Linguis- tics, 6:605-617. · DOI · Paper page
- Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier- ric Cistac, Tim Rault, Rémi Louf, Morgan Funtow- icz, and Jamie Brew. 2019. HuggingFace's trans- formers: State-of-the-art natural language process- ing. ArXiv.
Cited by
Sorted by citations
Items 301–400 of 456
Descriptor: Cultural Dialog and Safety Evaluation Multilingual Dataset (CAMEO8)
GUDIPATI, S. K., MISHRA, N. A., ANKAM, G., & PONUGOTI, S. (2025) · IEEE data descriptions. · doi:10.1109/ieeedata.2025.3638721 · Cited by 1
Liu, S. (2025) · Journal of Computer Science and Artificial Intelligence · doi:10.54097/kptt9j67 · Cited by 2
Casting criminals: a framework for evaluating demographic bias in AI-generated narratives
Sheikhi, G. (2025) · Journal of Intelligent Information Systems · doi:10.1007/s10844-025-01016-5 · Cited by 1
MCEval: A Dynamic Framework for Fair Multilingual Cultural Evaluation of LLMs
Huang, S., Yang, L., & Zhang, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3649395 · Cited by 3
Chand, S., Baca, F., & Ferrara, E. (2026) · AI · doi:10.3390/ai7010024 · Cited by 5
Towards a Fuzzy MCDM-Based Framework for Multi-Metric Bias Auditing in Generative AI
Ravikumar, R., Rajan, A. V., Narayan, A., & Maheshwari, P. (2025) · International Conference on Information Technology Trends (ITT) · doi:10.1109/itt69610.2025.11352932 · Cited by 1
Image-Guided Debiasing Distillation with Preference Alignment Across Multi-News Histories
Seo, J., Jo, E.-Y., Baek, H.-Y., Lee, D., Jin, X., & Oh, B. (2026) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3773966.3777983 · Cited by 2
Rad, A.-C., & Lemnaru, C. (2025) · International Conference on Computational Photography · doi:10.1109/iccp68926.2025.11427185 · Cited by 1
Toxicbias-reasoning: a multicultural dataset for social bias detection with human-aligned reasoning
Kumar, A., Gurve, M. K., Ahlawat, S., Prasad, Y., & Singh, V. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09916-w · Cited by 1
Farahani, F. J., Hanke, S., Heiberger, R. H., & Staab, S. (2026) · Journal of Social Computing · doi:10.23919/jsc.2026.0006 · Cited by 1
When to Invoke: Refining LLM Fairness with Toxicity Assessment
Ren, J., Li, B., Xu, Z., Luo, R., Yu, S. S., Ye, X., Fayek, H. M., Li, X., & Xia, F. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3793061 · Cited by 1
Lessons from shortcomings in machine learning for medical imaging
Varoquaux, G. P., & Cheplygina, V. (2023) · OECD eBooks · doi:10.1787/b885eecd-en · Cited by 2
An, H., & Rudinger, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.34 · Cited by 7
Morabito, R., Kabbara, J., & Emami, A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.280 · Cited by 1
Analyzing the Limits of Self-Supervision in Handling Bias in Language
Bauer, L., Gopalakrishnan, K., Gella, S., Liu, Y., Bansal, M., & Hakkani-Tür, D. Z. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.545 · Cited by 2
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns
Xie, Z., Kocijan, V., Lukasiewicz, T., & Camburu, O.-M. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.272 · Cited by 2
In-Depth Look at Word Filling Societal Bias Measures
Pikuliak, M., Beňová, I., & Bachratý, V. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.265 · Cited by 2
Chintam, A., Beloch, R., Zuidema, W. H., Hanna, M., & van der Wal, O. (2023) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2023.blackboxnlp-1.29 · Cited by 10
Mitigating Societal Harms in Large Language Models
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · doi:10.18653/v1/2023.emnlp-tutorial.5 · Cited by 1
Societal Versus Encoded Stereotypes in Text Encoders
Gaci, Y., Benatallah, B., Casati, F., & Benabdeslem, K. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00015 · Cited by 1
NoHateBrazil: A Brazilian Portuguese Text Offensiveness Analysis System
Vargas, F., Carvalho, I., Schmeisser-Nieto, W. S., Benevenuto, F., & Pardo, T. A. S. (2023) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-092-2_125 · Cited by 1
Shaier, S., Bennett, K., Hunter, L., & Kann, K. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.36 · Cited by 4
FairGauge: A Modularized Evaluation of Bias in Masked Language Models
Doughman, J., Shehata, S., & Karray, F. O. (2023) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3625007.3627592 · Cited by 1
All Should Be Equal in the Eyes of LMs: Counterfactually Aware Fair Text Generation
Banerjee, P., Java, A., Jandial, S., Shahid, S., Furniturewala, S., Krishnamurthy, B., & Bhatia, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29719 · Cited by 4
GECOBench: a gender-controlled text dataset and benchmark for quantifying biases in explanations
Wilming, R., Dox, A., Schulz, H., Oliveira, M., Clark, B., & Haufe, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1694388 · Cited by 6
Evaluating Social Bias in Code Generation Models
Ling, L. (2024) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3663529.3664462 · Cited by 5
Measuring Bias in Generated Text Using Language Models—GPT-2 and BERT
Masuma, F., Chakraborty, P., Islam, A.-A.-U., Talukder, P. C., Roy, P., & Yousuf, M. A. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-0892-5_39 · Cited by 1
From Bias to Fairness: The Role of Domain-Specific Knowledge and Efficient Fine-Tuning
Zheng, W., Yang, A., Lin, N., & Zhou, D. M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5669-8_29 · Cited by 1
Contextualizing Entity Representations for Zero-Shot Relation Extraction with Masked Language Models
Capshaw, R., & Blomqvist, E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77792-9_24
Debiasing Low-Resource Language Models Via Cross-Lingual Transfer Learning
Chauhan, A. (2024) · IEEE MIT Undergraduate Research Technology Conference (URTC) · doi:10.1109/urtc65039.2024.10937594 · Cited by 1
Prompts De-Biasing Augmentation to Mitigate Gender Stereotypes in Large Language Models
Chen, B., Binnewies, S., & Stantić, B. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6008-7_19 · Cited by 1
Stahl, M., Spliethöver, M., & Wachsmuth, H. (2022) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/2022.nlpcss-1.6 · Cited by 1
Measuring Gender Bias in West Slavic Language Models
Martinková, S., Stańczak, K., & Augenstein, I. (2023) · Workshop on Slavic Natural Language Processing (SlavicNLP) · doi:10.18653/v1/2023.bsnlp-1.17 · Cited by 3
Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark Datasets
Adewumi, T., Södergren, I., Alkhaled, L., Sabry, S. S., Liwicki, F., & Liwicki, M. (2023) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-092-2_001 · Cited by 1
A Discussion on Building Practical NLP Leaderboards: The Case of Machine TranslationPreprint
Santy, S., & Bhattacharya, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06292 · Cited by 3
Exploring the opportunities and limitations of large language models in biomedical sectorPreprint
Albarqawi, A. (2022) · Research Square · doi:10.21203/rs.3.rs-2401418/v1 · Cited by 1
Binaryvqa: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of Vqa ModelsPreprint
Borji, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4604468 · Cited by 3
Leveraging Crowd Intelligence to Enhance Fairness and Accuracy in AI-powered Recruitment DecisionsPreprint
Chen, Z., & Ma, Z. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5110822 · Cited by 1
Hamidavi, A. (2026) · Research Square · doi:10.21203/rs.3.rs-10369594/v1 · Cited by 1
Albarqawi, A. (2023) · Research Square · doi:10.21203/rs.3.rs-2401418/v2
Tourassi, G. D., Shankar, M. A., & Wang, F. (2023) · OECD eBooks · doi:10.1787/0e1b4c2f-en
Eroom’s Law and the decline in the productivity of biopharmaceutical R&D
Scannell, J. W. (2023) · OECD eBooks · doi:10.1787/6f256d17-en
The end of Moore’s Law? Innovation in computer systems continues at a high pace
Kressel, H. (2023) · OECD eBooks · doi:10.1787/63e48242-en · Cited by 1
Quantifying the “cognitive extent” of science and how it has changed over time and across countries
Milojević, S. (2023) · OECD eBooks · doi:10.1787/1f717652-en
Interpretability: Should – and can – we understand the reasoning of machine-learning systems?
Cartwright, H. (2023) · OECD eBooks · doi:10.1787/2d0478b9-en
OECD (2023) · OECD eBooks · doi:10.1787/f1262928-en
Kwon, B. C., & Mihindukulasooriya, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-demo.4
Stepping Stones for Self-Learning
Hai-Jew, S. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0074-9.ch005
Measuring bias in Instruction-Following models with P-AT
Onorati, D., Ruzzetti, E. S., Venditti, D., Ranaldi, L., & Zanzotto, F. M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.539
Libovický, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.71
Multilingual Fairness Analysis and Research based on Pre-Trained Models
(2023) · Journal of Innovation and Social Science Research · doi:10.53469/jissr.2023.10(12).07
OpenAI ChatGPT and the Accelerated Spread of Biased Information
Alsmadi, I. M., O’Brien, M. J., & Tuba, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-99-7569-3_2
Doughman, J., Shehata, S., Qadi, L. A., Nafea, Y., & Karray, F. (2023) · Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP) · doi:10.18653/v1/2023.eval4nlp-1.9
TorchQL: A Programming Framework for Integrity Constraints in Machine Learning
Naik, A., Stein, A., Wu, Y., Naik, M., & Wong, E. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3649841 · Cited by 2
Liu, Z., Li, G., Shi, B., Zhang, X., Ge, J., Wu, Y., & Lyu, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650172 · Cited by 1
Evaluating Nuanced Bias in Large Language Model Free Response Answers
Healey, J., Byrum, L., Akhtar, M. N., & Sinha, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70242-6_36
A Method for Implicit Risk Detection and Evaluation of Chinese LLMs through TextCNN
Liu, Z., Zhang, X., Ge, J., Li, G., Han, J., & Shi, B. (2024) · Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC) · doi:10.1109/ipec61310.2024.00083
A Study of Gender Bias in the Effects of Context Using BERT
Ueno, M., & Kobayashi, I. (2024) · Joint International Conference on Soft Computing and Intelligent Systems and International Symposium on Advanced Intelligent Systems (SCIS&ISIS) · doi:10.1109/scisisis61014.2024.10760173
Adversarially Exploring Vulnerabilities in LLMs to Evaluate Social Biases
Ong, Y. J., Gala, J. P., An, S., Moore, R. J., & Jadav, D. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825408 · Cited by 1
Aroeira: A Curated Corpus for the Portuguese Language with a Large Number of Tokens
Lira, T., Cação, F. N., de Souza, C. A., Valentini, J. P. H., Bollis, E., Oliveira, O., Almeida, R., Magalhães, M. L. D., Poloni, K. M., Oliveira, A., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-79029-4_13
Schema-tune: noise-driven bias mitigation in transformer-based language models
Shokrollahi, O., Penumatcha, R., Ensan, F., & Noorian, Z. (2025) · Machine Learning · doi:10.1007/s10994-024-06670-4
Detecting Linguistic Bias in Government Documents Using Large language Models
de Swart, M., den Hengst, F., & Chen, J. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714526
Individual Fairness in Generative Text Models
Whelan, B., & Patanè, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-82481-4_6
Acceptable Use Policies for Foundation Models
Klyman, K. (2024) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v1i1.10917
Debiasing Large Language Models with Structured Knowledge
Ma, C., Tianyu, Z. H. A. O., & Okumura, M. (2025) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2024edp7326
Masculine Defaults via Gendered Discourse in Podcasts and Large Language Models
Teleki, M., Dong, X., Liu, H., & Caverlee, J. (2025) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v19i1.35908
FairTriplet: Balancing Fairness and Accuracy in Contextual Pre-Trained Models Through Prefix Tuning
Long, Z., Zheng, W., Zhou, D., Zhou, Y., Lin, N., & Yang, A. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033465
An Adversarial Toxicity Prompt Generator Exploiting Multilingual Code-Switching in LLMs
Wadgaonkar, V. S., & Ratha, N. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00156
Pofcde: A Prompt-Based Debias Framework with Counterfactual Data Expansion
Zhuang, Y., & Zhou, D. M. (2025) · International Conference on Neural Networks, Information and Communication Engineering (NNICE) · doi:10.1109/nnice64954.2025.11064710
Structured Reasoning for Fairness: A Multi-agent Approach to Bias Detection in Textual Data
Huang, T., & Fan, E. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-98949-0_11
Contrastive Flip Probing for Bias Subspace Identification
Amin, M. N., & Jesser, A. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.07.146
Towards fairer AI: Integrating psychological insights into gender bias testing
Li, R. (2025) · AI & Society · doi:10.1007/s00146-025-02639-6
Gender Bias Mitigation in Advertisement Videos
Dinh, T. M. T., Thủy, N. T. T., & Colarik, A. M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-01169-5_15
Examining and Mitigating Ability-bias in LLMs via Self-Reflection
Iyer, N., Jha, A., & Pradhan, A. (2025) · International Web for All Conference (W4A) · doi:10.1145/3744257.3744268
Iyer, N., & Pradhan, A. (2025) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3715070.3749272 · Cited by 1
Qiu, X., Cheng, L., Hao, T., & Tan, X. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3630623
Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting
Zhou, E., & Lü, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_17
Frontiers in Multimodal AI: A Survey of Datasets and Benchmarks for Trustworthy Machine Intelligence
Ghajari, G., Majmaie, S. A., Jabo, S. A., Hasan, J., & Amsaad, F. (2025) · IEEE National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon65708.2025.11235327
Bias Detection in Online Higher Education Texts: Comparing Fine-Tuned and Zero-Shot LLM Approaches
Shiha, R. B., Atwell, E., & Abbas, N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11402-0_21
BharatBBQ: A Multilingual Bias Benchmark for Question Answering in the Indian Context
Tomar, A., Sahoo, N. R., & Bhattacharyya, P. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.55
Uncovering Cultural Biases and Stereotypes in Large Language Models
Dorleon, G., & Shujaa, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4861-3_5
Pyo, J., Jiao, Y., Chiang, Y., & Corey, M. (2025) · doi:10.1145/3764917.3771333
A red teaming framework for large language models: a case study on faithfulness evaluation
Alotaibi, A., Mughus, R., & Ahmed, M. (2026) · Software Quality Journal · doi:10.1007/s11219-026-09779-y · Cited by 1
Group size effects and collective misalignment in LLM multi-agent systems
Flint, A., Aiello, L. M., Pastor‐Satorras, R., & Baronchelli, A. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2531697123 · Cited by 26
Towards Responsible AI: Evaluating Large Language Models Across Trustworthy Dimensions
Xavier, S., Yogarajah, P., Incorvaia, G., & Chaurasia, P. (2025) · Irish Signals and Systems Conference · doi:10.1109/issc67739.2025.11290002
生成式语言模型在自动写作评估中的早期综述：自动作文评分与反馈生成领域的进展、挑战及方向
Yue, H., Palermo, C., Liu, R., & He, Y. (2025) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/kfps7749
Improving Fairness by Debiasing Intersectional Biases in Contextual AI Models
Abule, N., & Melo, G. (2025) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon66301.2025.00019
Zhao, W. X., Zhou, K., Li, J., Tang, T., & Wen, J.-R. (2025) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-96-6259-3_12
Yogarajan, V., Rayson, P., Dobbie, G., Keesing, A., Keegan, T. T., Benavides‐Prado, D., & Witbrock, M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6603-4_28
Behind the Words: Unmasking Bias Lurking in LLMs and Data
Dhingra, N., Kale, G., Chavan, H., & Arora, S. (2025) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon67554.2025.11378839
Detecting and Evaluating Bias in Large Language Models: Concepts, Methods, and Challenges
Gao, Z., Tong, L., & Zhang, Z. J. (2026) · Journal of Behavioral Data Science · doi:10.35566/jbds/gao · Cited by 1
Mapping Research on Social Cognitive Bias in Large Language Models
Zhang, S., Li, J., Gao, Y., Li, Y., Zhang, X., & Li, X. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00159
Reducing Social Biases in Language Models: A Comparative Evaluation of Debiasing Strategies
Kamboj, P., Kumar, S., & Goyal, V. (2025) · International Conference on Advanced Computing and Emerging Technologies (ACET) · doi:10.1109/acet67282.2025.11430255 · Cited by 1
Controlling Gender Bias in Retrieval via a Backpack Architecture
Afzali, A., Velae, A., Ahmadi, I., & Aliannejadi, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_47
Alignment Reduces Expressed but Not Encoded Gender Bias: A Unified Framework and Study
Bouchouchi, N., Lesot, M., Laugel, T., Renard, X., Marsala, C., & Detyniecki, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37654-1_21 · Cited by 1
Bias Mitigation in Large Language Models for Tabular Data Classification
Lu, H., Shao, Z., Gao, J., & Uddin, S. (2026) · Machine Learning · doi:10.1007/s10994-026-07030-0 · Cited by 1
AutoFairer: Automatic Bias Detection and Sanitization for LLMsPreprint
Nath, S., Uddin, G., & Raza, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6510396
A survey on bias and fairness in machine unlearning
Partohaghighi, M., Marcia, R. F., West, B. J., & Chen, Y. (2026) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2026.03.003 · Cited by 2
ViBBQ: Probing Social Biases in Vietnamese LLMs via Translated and Culturally Extended Benchmarks
Huynh, M.-P., Tu, P.-H., Trang, H. T. N., & Le, A.-C. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-21625-0_18
Metadata
- Authors
- Nangia, N., Vania, C., Bhalerao, R., & Bowman, S. R.
- Affiliations
- New York University (US)
- ORCID
- Bhalerao, Rasika
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2020
- Pages
- 1953-1967
- OpenAlex
- W3089430725
- Cited by
- 446
- References
- 35
- Citations by year
- 2026: 71 · 2025: 93 · 2024: 64 · 2023: 121 · 2022: 60 · 2021: 36 · 2020: 1
- FWCI
- 56.53
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- TIB Data Manager
- Funders
- National Science Foundation (1922658)
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- social bias, masked language models, stereotypes, benchmark dataset, race, age, crowdsourced data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
