The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Measuring and Mitigating Unintended Bias in Text Classification
Open accessAbstract
We introduce and illustrate a new approach to measuring and mitigating unintended bias in machine learning models. Our definition of unintended bias is parameterized by a test set and a subset of input features. We illustrate how this can be used to evaluate text classifiers using a synthetic test set and a public corpus of comments annotated for toxicity from Wikipedia Talk pages. We also demonstrate how imbalances in training data can lead to unintended bias in the resulting models, and therefore potentially unfair applications. We use a set of common demographic identity terms as the subset of input features on which we measure bias. This technique permits analysis in the common scenario where demographic information on authors and readers is unavailable, so that bias mitigation must focus on the content of the text itself. The mitigation method we introduce is an unsupervised approach based on balancing the training dataset. We demonstrate that this approach reduces the unintended bias without compromising overall model quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Synthetic data is valuable here because [11] shows that real data often has disproportionate amounts of toxicity directed at specific groups.”
From Model Cards for Model Reporting (2019) · cites this paper as [11]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prior work has shown that toxicity classifiers can pick up on biases in the training data and spuriously associate toxicity with the mention of certain demographics (Park et al., 2018; Dixon et al., 2018).”
From WILDS: A Benchmark of in-the-Wild Distribution Shifts (2020) · cites this paper as Dixon et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Ex Machina: Personal Attacks Seen at Scale
Wulczyn, E., Thain, N., & Dixon, L. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052591 · Cited by 636
Self-citationInherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 350
Gender and Dialect Bias in YouTube’s Automatic Captions
Tatman, R. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1606 · Cited by 338
The social impact of natural language processing
Hovy, D., & Spruit, S. L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2096 · Cited by 329
Data Decisions and Theoretical Implications when Adversarially Learning Fair RepresentationsPreprint
Beutel, A., Chen, J., Zhao, Z., & Chi, E. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00075 · Cited by 282
Cited by
Sorted by citations
Items 301–400 of 664
Race and Religion in Online Abuse towards UK Politicians: Working Paper
Gorrell, G., Bakir, M. E., Greenwood, M., Roberts, I. G., & Bontcheva, K. (2019) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1910.00920 · Cited by 12
Measuring Societal Biases from Text Corpora with Smoothed First-Order Co-occurrence
Rekabsaz, N., West, R., Henderson, J., & Hanbury, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v15i1.18083 · Cited by 12
Yildiz, B. (2022) · Turkish Journal of Science and Technology · doi:10.55525/tjst.1068940 · Cited by 12
TestSGD : Interpretable Testing of Neural Networks against Subtle Group Discrimination
Zhang, M., Sun, J., Wang, J., & Sun, B. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3591869 · Cited by 12
Bipartite Ranking Fairness Through a Model Agnostic Ordering Adjustment
Cui, S., Pan, W., Zhang, C., & Wang, F. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290949 · Cited by 13
Rawlsian Fair Adaptation of Deep Learning Classifiers
Shah, K., Gupta, P., Deshpande, A., & Bhattacharyya, C. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462592 · Cited by 12
Fine-Grained Fairness Analysis of Abusive Language Detection Systems with CheckList
Manerba, M. M., & Tonelli, S. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.9 · Cited by 12
An analysis of unconscious gender bias in academic texts by means of a decision algorithm
Orgeira-Crespo, P., Míguez‐Álvarez, C., Alonso, M. C., & Rivo-López, E. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257903 · Cited by 12
Towards Ethics by Design in Online Abusive Content DetectionPreprint
Kiritchenko, S., & Nejadgholi, I. (2020) · arXiv (Cornell University) · doi:10.4224/40002027 · Cited by 15
Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp
Hong, R., Agnew, W., Kohno, T., & Morgenstern, J. (2024) · Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3689904.3694702 · Cited by 11
BiasX: “Thinking Slow” in Toxic Content Moderation with Explanations of Implied Social Biases
Zhang, Y., Nanduri, S., Jiang, L., Wu, T., & Sap, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.300 · Cited by 16
Tu, G., Jing, R., Liang, B., Yang, M., Wong, K., & Xu, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.967 · Cited by 11
Algorithmic Issues, Challenges, and Theoretical Concerns of ChatGPT
Patil, P., Kulkarni, K., & Sharma, P. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-6824-4.ch003 · Cited by 11
HarmonyNet: Navigating hate speech detection
Raza, S., & Chatrath, V. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100098 · Cited by 11
Fairframe: a fairness framework for bias detection and mitigation in news
Sallami, D., & Aı̈meur, E. (2024) · AI and Ethics · doi:10.1007/s43681-024-00568-6 · Cited by 15
Towards Equal Gender Representation in the Annotations of Toxic Language Detection
Excell, E., & Moubayed, N. A. (2021) · Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2021.gebnlp-1.7 · Cited by 13
Syntax and prejudice: ethically-charged biases of a syntax-based hate speech recognizer unveiled
Mastromattei, M., Ranaldi, L., Fallucchi, F., & Zanzotto, F. M. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.859 · Cited by 11
Need of Mitigating Bias in the Datasets using Machine Learning Algorithms
Mandhala, V. N., Bhattacharyya, D., & Midhunchakkaravarthy, D. (2022) · International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI) · doi:10.1109/accai53970.2022.9752643 · Cited by 11
Manzoor, M. A., Hassan, S., Muazzam, A., Tuarob, S., & Nawaz, R. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03401-8 · Cited by 11
StereoKG: Data-Driven Knowledge Graph Construction For Cultural Knowledge and Stereotypes
Deshpande, A., Ruiter, D., Mosbach, M., & Klakow, D. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.7 · Cited by 15
Power of Explanations: Towards automatic debiasing in hate speech detection
Cai, Y., Zimek, A., Wunder, G., & Ntoutsi, E. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032325 · Cited by 11
Minimax AUC Fairness: Efficient Algorithm with Provable Convergence
Yang, Z., Ko, Y. L., Varshney, K. R., & Ying, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26405 · Cited by 11
Abusive words Detection in Persian tweets using machine learning and deep learning techniques
Dehghani, M., Dehkordy, D. T., & Bahrani, M. (2021) · International Conference on Signal Processing and Intelligent Systems (ICSPIS) · doi:10.1109/icspis54653.2021.9729390 · Cited by 11
Online Abuse of UK MPs from 2015 to 2019: Working PaperPreprint
Greenwood, M., Bakir, M. E., Gorrell, G., Song, X., Roberts, I. G., & Bontcheva, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11230 · Cited by 11
The Value of Disagreement in AI Design, Evaluation, and Alignment
Fazelpour, S., & Fleisher, W. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732146 · Cited by 10
Stoll, A., Wilms, L. M., & Ziegele, M. (2023) · Communication Methods and Measures · doi:10.1080/19312458.2023.2166028 · Cited by 10
Effectiveness and Information Quality Perception of an AI Model Card: A Study Among Non-Experts
Bracamonte, V., Pape, S., Löbner, S., & Tronnier, F. (2023) · Conference on Privacy, Security and Trust · doi:10.1109/pst58708.2023.10320197 · Cited by 10
Mitigating Large Language Model Bias: Automated Dataset Augmentation and Prejudice Quantification
Mondal, D., & Lipizzi, C. (2024) · Computers · doi:10.3390/computers13060141 · Cited by 10
Attanasio, G., & Pastor, E. (2020) · Accademia University Press eBooks · doi:10.4000/books.aaccademia.6807 · Cited by 10
Investigating Annotator Bias in Abusive Language Datasets
Wich, M., Widmer, C., Hagerer, G., & Groh, G. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_170 · Cited by 12
Revisiting Contextual Toxicity Detection in Conversations
Anuchitanukul, A., Ive, J., & Specia, L. (2022) · Journal of Data and Information Quality · doi:10.1145/3561390 · Cited by 10
Fair pairwise learning to rank
Cerrato, M., Köppel, M., Segner, A., Esposito, R., & Krämer, S. (2020) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa49011.2020.00083 · Cited by 11
Explaining classification performance and bias via network structure and sampling technique
Espín-Noboa, L., Karimi, F., Ribeiro, B., Lerman, K., & Wagner, C. (2021) · Applied Network Science · doi:10.1007/s41109-021-00394-3 · Cited by 10
Can We Improve Model Robustness through Secondary Attribute Counterfactuals?
Balashankar, A., Wang, X., Packer, B., Thain, N., Ed, H., & Beutel, A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.386 · Cited by 11
Self-citationA Mobile-Based System for Preventing Online Abuse and Cyberbullying
Salawu, S., Lumsden, J., & He, Y. (2022) · International Journal of Bullying Prevention · doi:10.1007/s42380-021-00115-5 · Cited by 10
FairShades: Fairness Auditing via Explainability in Abusive Language Detection Systems
Manerba, M. M., & Guidotti, R. (2021) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi52975.2021.00014 · Cited by 11
Flexible text generation for counterfactual fairness probing
Fryer, Z., Axelrod, V., Packer, B., Beutel, A., Chen, J., & Webster, K. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.20 · Cited by 10
Parolin, E. S., Hosseini, M., Hu, Y., Khan, L. R., Brandt, P. T., Osorio, J., & D'Orazio, V. J. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534178 · Cited by 10
Modeling the Second Player in Distributionally Robust OptimizationPreprint
Michel, P., Hashimoto, T., & Neubig, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10282 · Cited by 16
Detecting Inappropriate Messages on Sensitive Topics that Could Harm a Company's ReputationPreprint
Babakov, N., Logacheva, V., Kozlova, O., Semenov, N., & Panchenko, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05345 · Cited by 11
An Information Retrieval Approach to Building Datasets for Hate Speech DetectionPreprint
Rahman, M. M., Balakrishnan, D., Murthy, D., Kutlu, M., & Lease, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09775 · Cited by 16
Sen, I., Assenmacher, D., Samory, M., Augenstein, I., van der Aalst, W. M. P., & Wagner, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.649 · Cited by 18
Antonopoulou, C. (2023) · Technoetic Arts · doi:10.1386/tear_00109_1 · Cited by 9
Hostility on Twitter in the aftermath of terror attacks
Czymara, C. S., & Gorodzeisky, A. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00272-9 · Cited by 10
Dynamic Batch Processing with FlexiDecode Scheduler for Efficient LLM Inference in IIoT
Jia, X., Gu, B., Chen, J., Gao, L., Pang, W., Lv, G. D., Qu, Y., & Cui, L. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2025.9020025 · Cited by 9
Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluation
Zhang, C., Zhao, J., Zhang, H., Chang, K.-W., & Hsieh, C. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.305 · Cited by 9
Enhancing the fairness of offensive memes detection models by mitigating unintended political bias
Kumari, G., Sinha, A., Ekbal, A., Chatterjee, A. R., & Vinutha, B. N. (2024) · Journal of Intelligent Information Systems · doi:10.1007/s10844-023-00834-9 · Cited by 9
Understanding latent affective bias in large pre-trained neural language models
Kadan, A., Deepak, P., Bhadra, S., Gangan, M. P., & Lajish, V. L. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100062 · Cited by 10
The Black Lives Matter movement mitigates bias against racial minority actors
Lin, Y.-W., Yang, S., Han, W., & Lu, J. G. (2024) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.2307726121 · Cited by 8
Hate Speech Detection with Generalizable Target-aware Fairness
Chen, T., Wang, D., Liang, X., Risius, M., Demartini, G., & Yin, H. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671821 · Cited by 9
Toward Annotator Group Bias in Crowdsourcing
Liu, H., Thekinen, J., Mollaoglu, S., Tang, D. Q., Yang, J. S., Cheng, Y., Liu, H., & Tang, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.126 · Cited by 16
A study of bias mitigation strategies for speaker recognition
Peri, R., Somandepalli, K., & Narayanan, S. S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101481 · Cited by 17
Feature and Label Embedding Spaces Matter in Addressing Image Classifier Bias
Thong, W. E., & Snoek, C. G. M. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.46 · Cited by 9
Gondara, L., Simkin, J., Arbour, G., Devji, S., & Ng, R. T. (2024) · JCO Clinical Cancer Informatics · doi:10.1200/cci.24.00110 · Cited by 8
Examining Imbalance Effects on Performance and Demographic Fairness of Clinical Language Models
Jones, P., Liu, W., Huang, I., & Huang, X. (2025) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi64645.2025.00016 · Cited by 8
Improving Counterfactual Generation for Fair Hate Speech Detection
Davani, A. M., Omrani, A., Kennedy, B., Atari, M., Ren, X., & Dehghani, M. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.10 · Cited by 9
Explainable Abuse Detection as Intent Classification and Slot Filling
Calabrese, A., Roß, B., & Lapata, M. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00527 · Cited by 8
Bias Analysis in Healthcare Time Series (BAHT) Decision Support Systems from Meta Data
Dakshit, S., Dakshit, S., Khargonkar, N., & Prabhakaran, B. (2023) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-023-00133-6 · Cited by 8
Maximum Entropy Loss, the Silver Bullet Targeting Backdoor Attacks in Pre-trained Language Models
Liu, Z., Shen, B., Lin, Z., Wang, F., & Wang, W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.237 · Cited by 8
Conditional Supervised Contrastive Learning for Fair Text Classification
Chi, J., Shand, W., Yu, Y., Chang, K.-W., Zhao, H., & Tian, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.199 · Cited by 10
Indigenous Big Data Implications in New Zealand
Cherrington, M., Airehrour, D., Lu, J., Xu, Q., Wade, S., & Dunn, I. (2020) · International Telecommunication Networks and Applications Conference (ITNAC) · doi:10.1109/itnac50341.2020.9315078 · Cited by 8
Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking Fairness and Algorithm Utility
Cui, S., Pan, W., Zhang, C., & Wang, F. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467251 · Cited by 8
A Dataset and Baselines for Multilingual Reply Suggestion
Zhang, M., Wang, W., Deb, B., Zheng, G., Shokouhi, M., & Awadallah, A. H. (2021) · doi:10.18653/v1/2021.acl-long.97 · Cited by 8
Easy Adaptation to Mitigate Gender Bias in Multilingual Text Classification
Huang, X. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.52 · Cited by 8
Don’t let Ricci v. DeStefano Hold You Back: A Bias-Aware Legal Solution to the Hiring Paradox
Salem, J., Desai, D. R., & Gupta, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533129 · Cited by 9
An Investigation of Structures Responsible for Gender Bias in BERT and DistilBERT
Leteno, T., Gourru, A., Laclau, C., & Gravier, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30047-9_20 · Cited by 9
Díaz, M., & Diakopoulos, N. A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359228 · Cited by 9
Balancing Fairness and Accuracy in Sentiment Detection using Multiple Black Box Models
Almuzaini, A. A., & Singh, V. K. (2020) · doi:10.1145/3422841.3423536 · Cited by 8
Adversarial Scrubbing of Demographic Information for Text Classification
Chowdhury, S. B. R., Ghosh, S., Li, Y., Oliva, J. B., Srivastava, S., & Chaturvedi, S. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.43 · Cited by 13
Regional bias in monolingual English language models
Lyu, J., Dost, K., Koh, Y. S., & Wicker, J. S. (2024) · Machine Learning · doi:10.1007/s10994-024-06555-6 · Cited by 8
Systematic literature review on hate speech detection in Indian low-resource languages
Pannerselvam, K., & Rajiakodi, S. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-025-00432-5 · Cited by 5
Behind the Mask: Demographic bias in name detection for PII masking
Mansfield, C., Paullada, A., & Howell, K. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.10 · Cited by 12
Hate Speech Detection by Using Rationales for Judging Sarcasm
Mamun, M. B., Tsunakawa, T., Nishida, M., & Nishimura, M. (2024) · Applied Sciences · doi:10.3390/app14114898 · Cited by 7
Target Span Detection for Implicit Harmful Content
Jafari, N., Allan, J., & Sarwar, S. M. (2024) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3664190.3672525 · Cited by 10
Detecting Sensitive Content in Spoken Language
Tripathi, R. S., Dhamodharaswamy, B., Jagannathan, S., & Nandi, A. (2019) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2019.00052 · Cited by 7
Orgeira-Crespo, P., Míguez‐Álvarez, C., Alonso, M. C., & Ruiz, M. I. D. (2020) · Publications · doi:10.3390/publications8030041 · Cited by 7
Investigating Debiasing Effects on Classification and Explainability
Manerba, M. M., & Guidotti, R. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534170 · Cited by 7
Entity Matching with AUC-Based Fairness
Nilforoushan, S., Wu, Q., & Milani, M. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020293 · Cited by 7
Ghosh, S., & Kumar, S. (2021) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2021.semeval-1.29 · Cited by 7
DeSCoVeR: Debiased Semantic Context Prior for Venue Recommendation
Rajanala, S., Pal, A., Singh, M., Phan, R. C. ‐., & Wong, K. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531877 · Cited by 7
Towards Better Detection of Biased Language with Scarce, Noisy, and Biased Annotations
Li, Z., Lu, Z., & Yin, M. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534142 · Cited by 8
deepPIC: Deep Perceptual Image Clustering For Identifying Bias In Vision Datasets
Jaipuria, N., Stevo, K., Zhang, X., Gaopande, M. L., Garcia, I. C., Jain, J., & Murali, V. N. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00526 · Cited by 7
Mitigating sentimental bias via a polar attention mechanism
Yang, T., Yao, R., Yin, Q., Tian, Q., & Wu, O. (2020) · International Journal of Data Science and Analytics · doi:10.1007/s41060-020-00231-3 · Cited by 7
Measuring Model Fairness under Noisy Covariates: A Theoretical Perspective
Prost, F., Awasthi, P., Blumm, N., Kumthekar, A., Potter, T., Li, W., Wang, X., Ed, H., Chen, J., & Beutel, A. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462603 · Cited by 7
Lim, S., & Pérez‐Ortiz, M. (2024) · Research Square · doi:10.21203/rs.3.rs-5283007/v1 · Cited by 12
Stoll, A., Yu, J., Andrich, A., & Domahidi, E. (2025) · Communication Methods and Measures · doi:10.1080/19312458.2025.2551693 · Cited by 8
Identity-related Speech Suppression in Generative AI Content Moderation
Proebsting, G., Anigboro, O. I., Crawford, C. M., Metaxa, D., & Friedler, S. A. (2025) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3757887.3763010 · Cited by 8
Davidson, T. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02360-w · Cited by 7
Creative ML Assemblages: The Interactive Politics of People, Processes, and Products
Shelby, R., Srinivasan, R., Burgdorf, K., Lena, J. C., & Rostamzadeh, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637315 · Cited by 6
Alumnado subrepresentado e inteligencia artificial
Casas, R. M. R., González, R. F., & Santos-Garrido, M. (2024) · European Public & Social Innovation Review · doi:10.31637/epsir-2025-843 · Cited by 6
Does ChatGPT show gender bias in behavior detection?
Wu, J., Song, Y., & Wu, D. C. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04219-3 · Cited by 6
Remtulla, R., Samet, A., Kulbay, M., Akdag, A., Hocini, A., Volniansky, A., Ali, S. K., & Qian, C. X. (2025) · Biomedicines · doi:10.3390/biomedicines13020284 · Cited by 11
AI Pioneers and Stragglers in Greece: Challenges, Gaps, and Opportunities for Journalists and Media
Triantafyllou, S., Panagopoulos, A. M., & Kapos, P. (2025) · Societies · doi:10.3390/soc15080209 · Cited by 7
Deepfakes on the EU AI Act and Its Implementation in the Newsrooms
Panagopoulos, A. M., & Davalas, A. (2025) · International Journal of Social Science and Economic Research · doi:10.46609/ijsser.2025.v10i08.018 · Cited by 6
Measuring Fairness of Text Classifiers via Prediction Sensitivity
Krishna, S., Gupta, R., Verma, A., Dhamala, J., Pruksachatkun, Y., & Chang, K.-W. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.401 · Cited by 6
Mitigating Bias in Algorithmic Systems - A Fish-Eye View
Orphanou, K., Otterbacher, J., Kleanthous, S., Batsuren, K., Giunchiglia, F., Bogina, V., Tal, A. S., Hartman, A., & Kuflik, T. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.6240582 · Cited by 6
An Effective, Robust and Fairness-aware Hate Speech Detection Framework
Mou, G., & Lee, K. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9672022 · Cited by 6
Supporting Complaints Investigation for Nursing and Midwifery Regulatory Agencies
Lertvittayakumjorn, P., Petej, I., Gao, Y., Krishnamurthy, Y., van der Gaag, A., Jago, R., & Stathis, K. (2021) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2021.acl-demo.10 · Cited by 7
Metadata
- Authors
- Dixon, L., Li, J., Sorensen, J., Thain, N., & Vasserman, L.
- Affiliations
- Google (United States) (US)
- Venue
- Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2018-12-27
- Pages
- 67-73
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W2791170418
- Cited by
- 674
- References
- 11
- Citations by year
- 2026: 43 · 2025: 77 · 2024: 70 · 2023: 103 · 2022: 120 · 2021: 132 · 2020: 76 · 2019: 50 · 2018: 3
- FWCI
- 115.48
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Keywords
- text classification, bias mitigation, demographic bias, toxicity detection, Wikipedia talk pages, imbalanced training data, algorithmic fairness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
