AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
The DOI matches its Crossref record; 28 of the 31 references it cites were found in a registry or an index.
Abstract
Fairness is an increasingly important concern as machine learning models are used to support decision making in high-stakes applications such as mortgage lending, hiring, and prison sentencing. This article introduces a new open-source Python toolkit for algorithmic fairness, AI Fairness 360 (AIF360), released under an Apache v2.0 license (https://github.com/ibm/aif360). The main objectives of this toolkit are to help facilitate the transition of fairness research algorithms for use in an industrial setting and to provide a common framework for fairness researchers to share and evaluate algorithms. The package includes a comprehensive set of fairness metrics for datasets and models, explanations for these metrics, and algorithms to mitigate bias in datasets and models. It also includes an interactive Web experience that provides a gentle introduction to the concepts and capabilities for line-of-business users, researchers, and developers to extend the toolkit with their new algorithms and improvements and to use it for performance benchmarking. A built-in testing infrastructure maintains code quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the Linux Foundation, which hosts several of the open source tools we found (IBM's AI Fairness 360 [15], for example).”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“An open-source toolkit, the AI Fairness 360, is available to help AI researchers examine, report, and mitigate discrimination and bias in machine learning models throughout the AI development lifecycle [52].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“It includes a comprehensive set of metrics for datasets and models to test for biases, explanations for those metrics, and algorithms to mitigate bias in datasets and models.”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“If bias is discovered in an algorithm, a variety of solutions are now available to help mitigate and reduce the level of bias (Bellamy et al., 2019).”
From Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health (2021) · cites this paper as Bellamy et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Various toolboxes have been released in the past years to assist the algorithm experimentation and software development to enhance AI trustworthiness in different aspects such as fairness [12, 13, 71], XAI [56, 1, 8], and adversarial robustness [55, 2].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [12]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387
Data preprocessing techniques for classification without discrimination
Kamiran, F., & Calders, T. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0463-8 · Cited by 1,305
(2013) · Cited by 1,126
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995
Optimized Pre-Processing for Discrimination Prevention
Calmon, F. P., Wei, D., Vinzamuri, B., Ramamurthy, K. N., & Varshney, K. R. (2017) · neural information processing systems · Cited by 978
Self-citationInherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943
Research works printed but not linked: 4
- Kohavi, R. Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining , 1996. URL https://archive. ics.uci.edu/ml/datasets/adult .
- Kusner, M. J., Loftus, J. R., Russell, C., and Silva, R. Counterfactual fairness. In NIPS , 2017.
- bellamy, 2018, AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias, arXiv 1810 01943
- Narayanan, A. Translation tutorial: 21 fairness definitions and their politics. In Conference on Fairness, Accountability, and Transparency , February 2018.
Cited by
Items 501–600 of 1,009
What Is Fair? Defining Fairness in Machine Learning for Health
Gao, J., Chou, B., McCaw, Z. R., Thurston, H., Varghese, P., Hong, C., & Gronsbell, J. L. (2025) · Statistics in Medicine · doi:10.1002/sim.70234 · Cited by 30
Visual Auditor: Interactive Visualization for Detection and Summarization of Model Biases
Munechika, D., Wang, Z. J., Reidy, J., Rubin, J., Gade, K., Kenthapadi, K., & Chau, D. H. (2022) · Visualization · doi:10.1109/vis54862.2022.00018 · Cited by 28
Bias in Artificial Intelligence: Basic Primer
Park, Y., & Hu, J. (2023) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.0000000000000078 · Cited by 20
Investigating fairness in machine learning-based audio sentiment analysis
Luitel, S., Liu, Y., & Anwar, M. M. (2024) · AI and Ethics · doi:10.1007/s43681-024-00453-2 · Cited by 25
“A growing number of researchers have realized that the “one-size-fits-all” approach does not fit at all in AI systems and are committed to creating and designing AI algorithms that are trustworthy [6], fair [7], and unbiased [8, 9].”
Procedural Fairness in Machine Learning
Wang, Z., Huang, C., Tang, K., & Yao, X. (2026) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.20498 · Cited by 24
“The individual procedural fairness of the ML model is defined as that two similar samples should have similar decision logic/process.”
Madaio, M., Chen, J., Wallach, H., & Vaughan, J. W. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3653705 · Cited by 30
Achieve fairness without demographics for dermatological disease diagnosis
Chiu, C.-H., Chen, Y.-J., Wu, Y., Shi, Y., & Ho, T.-Y. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103188 · Cited by 25
Bring Your Own Prompts: Use-Case-Specific Bias and Fairness Evaluation for LLMs
Bouchard, D. (2026) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2026.ltedi-1.2 · Cited by 24
fairadapt: Causal Reasoning for Fair Data Preprocessing
Plečko, D., Bennett, N., & Meinshausen, N. (2024) · Journal of Statistical Software · doi:10.18637/jss.v110.i04 · Cited by 28
FairDRO: Group fairness regularization via classwise robust optimization
Park, T., Jung, S., Chun, S., & Moon, T. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106891 · Cited by 23
Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations
Sakib, S. K., & Das, A. B. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825082 · Cited by 49
Towards Generating Consumer Labels for Machine Learning Models
Seifert, C., Scherzinger, S., & Wiese, L. (2019) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi48466.2019.00033 · Cited by 31
Fairness improvement for black-box classifiers with Gaussian process
Nguyen, D., Gupta, S., Rana, S., Shilton, A., & Venkatesh, S. (2021) · Information Sciences · doi:10.1016/j.ins.2021.06.095 · Cited by 27
Algorithmic Fairness Verification with Graphical Models
Ghosh, B., Basu, D., & Meel, K. S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21187 · Cited by 28
Trusted Artificial Intelligence: Technique Requirements and Best Practices
Zhang, T., Qin, Y., & Li, Q. (2021) · International Conference on Cyberworlds (CW) · doi:10.1109/cw52790.2021.00058 · Cited by 25
Proceedings of the 20th Python in Science Conference
Kapoor, V., & Carabaña, C. (2021) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-1b6fd038-02b · Cited by 20
A Burden Shared is a Burden Halved: A Fairness-Adjusted Approach to Classification
Rava, B., Sun, W., James, G. M., & Tong, X. (2026) · Journal of the American Statistical Association · doi:10.1080/01621459.2026.2634937 · Cited by 21
Transitioning from Real to Synthetic data: Quantifying the bias in modelPreprint
Gupta, A., Bhatt, D., & Pandey, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04144 · Cited by 28
The Rich Get Richer: Disparate Impact of Semi-Supervised LearningPreprint
Zhu, Z., Luo, T., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.06282 · Cited by 23
Genovesi, S., Mönig, J. M., Schmitz, A., Poretschkin, M., Akila, M., Kahdan, M., Kleiner, R., Krieger, L., & Zimmermann, A. (2024) · AI and Ethics · doi:10.1007/s43681-023-00291-8 · Cited by 19
“Many of the presented bias quantification and detection approaches have been implemented in (partially) open-source packages and tools [3, 9, 40] and are likewise applicable to input–output-mappings not based on ML.”
BackgroundEnd-To-End Bias Mitigation: Removing Gender Bias in Deep Learning
Feldman, T., & Peake, A. (2021) · arXiv · doi:10.48550/arxiv.2104.02532 · Cited by 19
FaiR-N: Fair and Robust Neural Networks for Structured Data
Sharma, S., Gee, A. H., Paydarfar, D., & Ghosh, J. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462559 · Cited by 28
Using Machine Learning in Admissions: Reducing Human and Algorithmic Bias in the Selection Process
Neda, B. M., Zeng, Y., & Gago–Masague, S. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3439664 · Cited by 19
Juijn, G., Stoimenova, N., Reis, J., & Nguyen, D. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604677 · Cited by 23
Perceptive Biases in Construction Mediation: Evidence and Application of Artificial Intelligence
Cao, N., Cheung, S. O., & Li, K. (2023) · Buildings · doi:10.3390/buildings13102460 · Cited by 23
Oladele, R. I., Orelaja, A., & Akinwande, O. T. (2024) · International Journal of Latest Technology in Engineering Management & Applied Science · doi:10.51583/ijltemas.2024.130207 · Cited by 22
Dehal, R. S., Sharma, M., & Santos, R. D. S. (2024) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1145/3639475.3640098 · Cited by 21
“These initiatives approach the problem from various angles, including the improvement of software development [3, 20], the implementation of fairness testing to mitigate bias [7], and considerations from a software management standpoint [20, 25].”
BackgroundJaved, H., Muqeet, H. A., Danesh, A., Rehman, A. U., Javed, T., & Bermak, A. (2024) · IEEE Access · doi:10.1109/access.2024.3443812 · Cited by 20
“Engaging multidisciplinary teams in the development process, including ethicists, clinicians, and patients, can help in identifying and addressing potential ethical issues [37].”
BackgroundQuantifying Bias in Text-to-Image Generative Models
Vice, J., Akhtar, N., Hartley, R. I., & Mian, A. S. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3572115 · Cited by 21
Human-AI Interaction Design Standards
Zhao, C., & Xu, W. (2026) · Springer eBooks · doi:10.1007/978-981-95-5585-7_16 · Cited by 20
Faking Fairness via Stealthily Biased Sampling
Fukuchi, K., Hara, S., & Maehara, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5377 · Cited by 30
Enforcing fairness in logistic regression algorithm
Radovanović, S., Petrović, A., Delibašić, B., & Suknović, M. (2020) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista49547.2020.9194676 · Cited by 24
Towards Fairness-Aware Disaster Informatics: an Interdisciplinary Perspective
Yang, Y., Zhang, C., Fan, C. H., Mostafavi, A., & Hu, X. (2020) · IEEE Access · doi:10.1109/access.2020.3035714 · Cited by 25
Did You Do Your Homework? Raising Awareness on Software Fairness and Discrimination
Hort, M., & Sarro, F. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678568 · Cited by 27
Wang, H., Wu, Z., & He, J. (2024) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3616855.3635844 · Cited by 33
Challenges to the monitoring of deployed AI systems: Center for AI Standards and Innovation
Rao, A., Keller, D., Kalra, N., Steed, R., Kwegyir-Aggrey, K., Klyman, K., Staheli, D., & Bergman, S. (2026) · doi:10.6028/nist.ai.800-4 · Cited by 30
Question-Driven Design Process for Explainable AI User Experiences
Liao, Q. V., Pribić, M., Han, J., Miller, S., & Sow, D. (2021) · arXiv · doi:10.48550/arxiv.2104.03483 · Cited by 18
Toward A Two-Sided Fairness Framework in Search and Recommendation
Liu, J. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578332 · Cited by 27
Mitigating Age Biases in Resume Screening AI Models
Harris, C. G. (2023) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.36.133236 · Cited by 20
“First, we use the AI Fairness 360 toolkit (Bellamy et al., 2019).”
BackgroundMethodInfluentialQuality challenges in Deep Learning Data Collection in perspective of Artificial Intelligence
Vidhya, G. M. P. S., Nirmala, D., & Manju, T. (2023) · Journal of Information Technology and Computing · doi:10.48185/jitc.v4i1.725 · Cited by 19
“corporate data lakes [28] or on the Web [29].”
BackgroundCertPri: Certifiable Prioritization for Deep Neural Networks via Movement Cost in Feature Space
Zheng, H., Chen, J., & Jin, H. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00126 · Cited by 23
“, structured data [39] and graph data [40]) mutation strategies.”
BackgroundShivaprasad, S., Chadaga, K., Dias, C. C., Sampathila, N., & Prabhu, S. (2024) · Systems Science & Control Engineering · doi:10.1080/21642583.2024.2364033 · Cited by 19
Kondra, S., Medapati, S., Koripalli, M., Nandula, S. R. S. C., & Zink, J. (2025) · Journal of Artificial intelligence and Machine Learning · doi:10.55124/jaim.v3i1.249 · Cited by 10
Making Fair ML Software using Trustworthy Explanation
Chakraborty, J., Peng, K., & Menzies, T. (2020) · Figshare · doi:10.6084/m9.figshare.12612449 · Cited by 19
Singh, C., Zhao, L., Lin, W., & Ye, Z. (2021) · Journal of Financial Crime · doi:10.1108/jfc-06-2021-0131 · Cited by 23
Nápoles, G., & Koumeri, L. K. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.01.005 · Cited by 22
Merkaj, S., Bahar, R. C., Zeevi, T., Lin, M., Ikuta, I., Bousabarah, K., Petersen, G. C., Staib, L. H., Payabvash, S., Mongan, J., et al. (2022) · Cancers · doi:10.3390/cancers14112623 · Cited by 20
“Thousands of studies pertaining to applications of AI and ML in medical imaging have been published [15,82].”
BackgroundMethodCounterfactual Fairness Is Basically Demographic Parity
Rosenblatt, L., & Witter, R. T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26691 · Cited by 30
Statistical inference for individual fairnessPreprint
Maity, S., Xue, S., Yurochkin, M., & Sun, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.16714 · Cited by 23
Lammert, J. M., Roberts, A. C., McRae, K., Batterink, L. J., & Butler, B. E. (2025) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2024_jslhr-24-00515 · Cited by 17
Navigating AI conformity: A design framework to assess fairness, explainability, and performance
von Zahn, M., Zacharias, J., Lowin, M., Chen, J., & Hinz, O. F. (2025) · Electronic Markets · doi:10.1007/s12525-025-00770-2 · Cited by 22
“Furthermore, there are several other assessment tools that are similar to FairX (see, e.g., AI Fairness 360 by Bellamy et al. (2019), or Fairlearn by Bird et al. (2020)).”
A systematic review of algorithm auditing processes to assess bias and risks in AI systems
Funda, V. (2025) · Journal of Infrastructure Policy and Development · doi:10.24294/jipd11489 · Cited by 17
A study of bias mitigation strategies for speaker recognition
Peri, R., Somandepalli, K., & Narayanan, S. S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101481 · Cited by 22
Learning for Counterfactual Fairness from Observational Data
Ma, J., Guo, R., Zhang, A., & Li, J. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599408 · Cited by 30
Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360
Blow, C. H., Qian, L., Gibson, C. A., Obiomon, P., & Dong, X. (2024) · Applied Sciences · doi:10.3390/app14093826 · Cited by 22
Salehi, P., Ba, Y., Kim, N., Mosallanezhad, A., Pan, A., Cohen, M. C., Wang, Y., Zhao, J. L., Bhatti, S. A., Sung, J., et al. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14990 · Cited by 17
“These include but are not limited to, the Microsoft UX Design Principle (Microsoft, 1995), NISTIR 8330 by National Institute of Standards and Technology (Stanton & Jensen, 2021), AI Fairness 360 Toolkit by IBM (Bellamy et al., 2019, and others), IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems (C…”
MethodFagbola, T. M., & Thakur, S. C. (2019) · International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS) · doi:10.1109/iciibms46890.2019.8991505 · Cited by 19
librec-auto: A Tool for Recommender Systems Experimentation
Sonboli, N., Mansoury, M., Guo, Z., Kadekodi, S., Liu, W., Liu, Z., Schwartz, A., & Burke, R. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482006 · Cited by 19
“360 – an open source toolkit for mitigating bias in AI application lifecycle designed by IBM [8], Fairlearn – a toolkit for assessing and improving fairness in AI designed by Microsoft [12], Aequitas – an open-source bias audit toolkit that allows auditingmachine learning models for discrimination and bias [39], Linke…”
MethodGender Neutralisation for Unbiased Speech Synthesising
Rizhinashvili, D., Sham, A. H., & Anbarjafari, G. (2022) · Electronics · doi:10.3390/electronics11101594 · Cited by 20
Wiśniewski, J., & Biecek, P. (2022) · The R Journal · doi:10.32614/rj-2022-019 · Cited by 23
Understanding Fairness Requirements for ML-based Software
Baresi, L., Criscuolo, C., & Ghezzi, C. (2023) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re57278.2023.00046 · Cited by 25
Challenges of Machine Learning and AI (What Is Next?), Responsible and Ethical AI
Gkontra, P., Quaglio, G., Garmendia, A. T., & Lekadir, K. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_17 · Cited by 22
Rieskamp, J., Hofeditz, L., Mirbabaie, M., & Stieglitz, S. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.026 · Cited by 24
Horesh, Y., Haas, N., Mishraky, E., Resheff, Y. S., & Lador, S. M. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-43823-4_47 · Cited by 20
Fair Robust Assignment Using Redundancy
Malencia, M., Kumar, V., Pappas, G. J., & Prorok, A. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3067283 · Cited by 17
“FAIRNESS in algorithms has received increasing attention in both research [3], [4], [31] and policy [9], [27], [32].”
BackgroundMethodDesigning Tools for Semi-Automated Detection of Machine Learning Biases: An Interview StudyPreprint
Law, P.-M., Malik, S., Du, F., & Sinha, M. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/uvjqh · Cited by 18
Debiasing Classifiers: Is Reality at Variance With Expectation?Preprint
Agrawal, A., Pfisterer, F., Bischl, B., Chen, J., Sood, S., Shah, S., Buet-Golfouse, F., Mateen, B. A., & Vollmer, S. J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3711681 · Cited by 20
A fairness-focused approach to recidivism prediction: implications for accuracy, trust, and equity
Farayola, M. M., Tal, I., Saber, T., Connolly, R., & Bendechache, M. (2025) · AI & Society · doi:10.1007/s00146-025-02452-1 · Cited by 24
A review of state-of-the-art techniques for large language model compression
Dantas, P. V., Cordeiro, L. C., & Waldir, S. S. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-02019-z · Cited by 30
Abbott, E. E., Rehman, T., Rosania, A. R., Lum, D. L., Taylor, T. B., Kirk, A., Taylor, R. A., Baker, E. F., Rabin, E., Padela, A. I., et al. (2025) · Journal of the American College of Emergency Physicians Open · doi:10.1016/j.acepjo.2025.100311 · Cited by 17
An Empirical Study on Algorithmic Bias
Sen, S., Dasgupta, D., & Gupta, K. D. (2020) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac48688.2020.00-95 · Cited by 16
iFlipper: Label Flipping for Individual Fairness
Zhang, H., Tae, K. H., Park, J., Chu, X., & Whang, S. E. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3588688 · Cited by 22
L’intelligence artificielle peut-elle être une innovation responsable ?
Vuarin, L., Lopes, P. G., & Massé, D. (2023) · Innovations · doi:10.3917/inno.pr2.0153 · Cited by 18
Lay User Involvement in Developing Human-centric Responsible AI Systems: When and How?
Vincenzi, B., Stumpf, S., Taylor, A. S., & Nakao, Y. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3652592 · Cited by 17
Soltan, A., & Washington, P. Y. (2024) · Algorithms · doi:10.3390/a17040141 · Cited by 18
Strategies to improve fairness in artificial intelligence:A systematic literature review
Trigo, A., Stein, N., & Belfo, F. P. (2024) · Education for Information · doi:10.3233/efi-240045 · Cited by 20
“Only three papers cite the use of unsupervised algorithms: NN (Bellamy et al., 2019; H. Zhang et al., 2021), CNN (Obaidat et al., 2021).”
Pelekis, S., Karakolis, E., Lampropoulos, G., Mouzakitis, S., Markaki, O. I., Ntanos, C., & Askounis, D. (2024) · IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) · doi:10.1109/ice/itmc61926.2024.10794222 · Cited by 23
Miazek, K., & Bocian, K. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100719 · Cited by 16
Jabbarpour, M. R., Saghiri, A. M., & Sookhak, M. (2021) · Electronics · doi:10.3390/electronics10040384 · Cited by 20
“This issue is recently reported as a hot topic in machine learning, and papers such as [22,23] are reported in the literature depicting modified machine learning algorithms (removing bios considering special fields) while considering this issue.”
BackgroundDisparate Impact Diminishes Consumer Trust Even for Advantaged Users
Draws, T., Szlávik, Z., Timmermans, B., Tintarev, N., Varshney, K. R., & Hind, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79460-6_11 · Cited by 18
“Although several methods have been developed to mitigate algorithmic unfairness [7], in many cases it is currently not possible to do so to a satisfactory degree [8].”
MethodSelf-citationA literature review on artificial intelligence and ethics in online learning
Casas-Roma, J., & Conesa, J. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823410-5.00006-1 · Cited by 20
UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Models
Krishnakumar, A., Prabhu, V., Sudhakar, S., & Hoffman, J. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.102 · Cited by 34
BiasHeal: On-the-Fly Black-Box Healing of Bias in Sentiment Analysis Systems
Yang, Z., Jain, H., Shi, J., Asyrofi, M. H., & Lo, D. (2021) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme52107.2021.00073 · Cited by 21
Interpretability of Machine Learning Models: How Can One Explain Machine Learning Models?
Czerwińska, U. (2022) · Tourism on the verge · doi:10.1007/978-3-030-88389-8_14 · Cited by 23
The AI field needs translational Ethical AI research
Borg, J. S. (2022) · AI Magazine · doi:10.1002/aaai.12062 · Cited by 20
“2019), IBM Fairness 360 (Bellamy et al. 2019), Aequitas (Saleiro et al.”
BackgroundApplication of fairness to healthcare, organizational justice, and finance: A survey
Birzhandi, P., & Cho, Y.-S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119465 · Cited by 22
Social norm bias: residual harms of fairness-aware algorithms
Cheng, M., De‐Arteaga, M., Mackey, L. W., & Kalai, A. T. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00910-8 · Cited by 21
“We use the implementation in the AI Fairness 360 Python package (Bellamy et al. 2019).”
MethodFairness through Aleatoric Uncertainty
Tahir, A., Cheng, L., & Liu, H. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614875 · Cited by 35
Subgroup Robustness Grows on Trees: An Empirical Baseline Investigation
Gardner, J., Popovic, Z., & Schmidt, L. (2022) · neural information processing systems · doi:10.52202/068431-0722 · Cited by 33
Estimating Kullback-Leibler Divergence Using Kernel Machines
Ahuja, K. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9049082 · Cited by 18
Arbiter: A Domain-Specific Language for Ethical Machine Learning
Zucker, J., & d'Leeuwen, M. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375858 · Cited by 24
Sudhakar, M., Sattarzadeh, S., Plataniotis, K. N., Jang, J., Jeong, Y., & Kim, H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414942 · Cited by 20
“To ensure the uniformity of the training data’s distribution, lately, there is an increase in modern open-source toolkits [3, 4] that acts as a common framework to evaluate a model’s fairness.”
BackgroundBias Mitigation Post-processing for Individual and Group FairnessPreprint
Lohia, P., Ramamurthy, K. N., Bhide, M. A., Saha, D., Varshney, K. R., & Puri, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06135 · Cited by 24
Self-citationFair Classification with Noisy Protected Attributes: A Framework with Provable GuaranteesPreprint
Celis, L. E., Huang, L., Keswani, V., & Vishnoi, N. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04778 · Cited by 31
Uncovering the Bias in Facial ExpressionsPreprint
Deuschel, J., Finzel, B., & Rieger, I. (2021) · doi:10.20378/irb-50304 · Cited by 17
Towards Responsible AI in Banking: Addressing Bias for Fair Decision-MakingPreprint
Castelnovo, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.08691 · Cited by 21
A Unified Post-Processing Framework for Group Fairness in ClassificationPreprint
Xian, R., & Zhao, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.04025 · Cited by 17
Wei, J., Qi, S., Wang, W., Jiang, L., Gao, H., Zhao, F., Al-Bukhaiti, K., & Wan, A. (2025) · Contemporary Mathematics · doi:10.37256/cm.6220256459 · Cited by 15
“To address this, frameworks such as AI Impartiality 360 [118] as well as Open Algorithm [110] offer preprocessing, inprocessing, as well as post-processing techniques aimed at reducing bias, though not eliminating it entirely.”
AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AI
Hiniduma, K., Byna, S., Bez, J. L., & Madduri, R. (2024) · Proceedings of the 36th International Conference on Scientific and Statistical Database Management · doi:10.1145/3676288.3676296 · Cited by 15
The Use of Artificial Intelligence in Residency Application Evaluation—A Scoping Review
Sumner, M. D., Howell, T. C., Soto, A. L., Kaplan, S. J., Tracy, E. T., Zaas, A. K., Migaly, J., Kirk, A. D., & Shah, K. N. (2025) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-24-00604.1 · Cited by 19
Metadata
- Authors
- Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., Nagar, S., Ramamurthy, K. N., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K. R., & Zhang, Y.
- ORCID
- Venue
- IBM Journal of Research and Development
- Publisher
- IBM
- Published
- 2019-07-01
- Volume
- 63
- Issue
- 4/5
- Pages
- 4:1-4:15
- ISSN
- 0018-8646 (ISSN-L)
- OpenAlex
- W2974817986
- Cited by
- 884
- References
- 31
- Citations by year
- 2026: 163 · 2025: 226 · 2024: 145 · 2023: 143 · 2022: 99 · 2021: 69 · 2020: 35 · 2019: 4
- FWCI
- 90.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IBM Journal of Research and Development (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Keywords
- algorithmic fairness, algorithmic bias detection, bias mitigation, fairness metrics, open-source software toolkit, high-stakes decision making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.