AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
The DOI matches its Crossref record; 28 of the 31 references it cites were found in a registry or an index.
Abstract
Fairness is an increasingly important concern as machine learning models are used to support decision making in high-stakes applications such as mortgage lending, hiring, and prison sentencing. This article introduces a new open-source Python toolkit for algorithmic fairness, AI Fairness 360 (AIF360), released under an Apache v2.0 license (https://github.com/ibm/aif360). The main objectives of this toolkit are to help facilitate the transition of fairness research algorithms for use in an industrial setting and to provide a common framework for fairness researchers to share and evaluate algorithms. The package includes a comprehensive set of fairness metrics for datasets and models, explanations for these metrics, and algorithms to mitigate bias in datasets and models. It also includes an interactive Web experience that provides a gentle introduction to the concepts and capabilities for line-of-business users, researchers, and developers to extend the toolkit with their new algorithms and improvements and to use it for performance benchmarking. A built-in testing infrastructure maintains code quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the Linux Foundation, which hosts several of the open source tools we found (IBM's AI Fairness 360 [15], for example).”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“An open-source toolkit, the AI Fairness 360, is available to help AI researchers examine, report, and mitigate discrimination and bias in machine learning models throughout the AI development lifecycle [52].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“It includes a comprehensive set of metrics for datasets and models to test for biases, explanations for those metrics, and algorithms to mitigate bias in datasets and models.”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“If bias is discovered in an algorithm, a variety of solutions are now available to help mitigate and reduce the level of bias (Bellamy et al., 2019).”
From Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health (2021) · cites this paper as Bellamy et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Various toolboxes have been released in the past years to assist the algorithm experimentation and software development to enhance AI trustworthiness in different aspects such as fairness [12, 13, 71], XAI [56, 1, 8], and adversarial robustness [55, 2].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [12]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387
Data preprocessing techniques for classification without discrimination
Kamiran, F., & Calders, T. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0463-8 · Cited by 1,305
(2013) · Cited by 1,126
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995
Optimized Pre-Processing for Discrimination Prevention
Calmon, F. P., Wei, D., Vinzamuri, B., Ramamurthy, K. N., & Varshney, K. R. (2017) · neural information processing systems · Cited by 978
Self-citationInherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943
Research works printed but not linked: 4
- Kohavi, R. Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining , 1996. URL https://archive. ics.uci.edu/ml/datasets/adult .
- Kusner, M. J., Loftus, J. R., Russell, C., and Silva, R. Counterfactual fairness. In NIPS , 2017.
- bellamy, 2018, AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias, arXiv 1810 01943
- Narayanan, A. Translation tutorial: 21 fairness definitions and their politics. In Conference on Fairness, Accountability, and Transparency , February 2018.
Cited by
Items 601–700 of 1,009
Patel, D., Kantamneni, R., John, J. D., Patel, T., Shukla, A., Salma, A., & Anand, N. (2025) · Annals of Medicine and Surgery · doi:10.1097/ms9.0000000000004607 · Cited by 15
“These audits should be a standard step in the model deployment lifecycle [ 36 ] .”
Embedding AI ethics in the data lifecycle: A framework for enterprise AI governance
Huang, X., Kou, T., & Zhou, Q. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103261 · Cited by 15
Wang, Z., Yang, J. C., Shang, W., & Ding, J. (2026) · IEEE Access · doi:10.1109/access.2026.3692578 · Cited by 25
“Furthermore, most fairness studies focus on domains such as criminal justice, lending, and healthcare [17], with comparatively limited exploration of human resource management contexts where organizational nuances and regulatory frameworks introduce unique challenges [4], [18].”
Collect, Measure, Repeat: Reliability Factors for Responsible AI Data Collection
Inel, O., Draws, T., & Aroyo, L. M. (2023) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v11i1.27547 · Cited by 25
Gupta, A., Carpenter, D., Min, W., Rowe, J., Azevedo, R., & Lester, J. C. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00379-6 · Cited by 17
Search-based Automatic Repair for Fairness and Accuracy in Decision-making Software
Hort, M., Zhang, J. M., Sarro, F., & Harman, M. (2024) · Empirical Software Engineering · doi:10.1007/s10664-023-10419-3 · Cited by 20
Fairframe: a fairness framework for bias detection and mitigation in news
Sallami, D., & Aïmeur, E. (2024) · AI and Ethics · doi:10.1007/s43681-024-00568-6 · Cited by 19
Attesting Digital Discrimination Using Norms.
Criado, N., Ferrer, X., & Such, J. M. (2021) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2021.02.008 · Cited by 15
“The other violations above indicate that black people and nicaraguans have a disproportionate lower probability of being classified as making more than 50k when compared with other groups, in accordance with previous reports of discrimination in the dataset [15].”
ResultUnderstanding User Sensemaking in Machine Learning Fairness Assessment Systems
Gu, Z., Yan, J. N., & Rzeszotarski, J. M. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450092 · Cited by 20
DataPrism: Exposing Disconnect between Data and Systems
Galhotra, S., Fariha, A., Lourenço, R., Freire, J., Meliou, A., & Srivastava, D. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517864 · Cited by 20
Wang, L., & Zhu, H. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533147 · Cited by 20
“For example, users are empowered with interactive interfaces to visually examine the behavior of machine learning models and identify potential biases [3, 68].”
BackgroundRepresentational ethical model calibration
Carruthers, R., Straw, I., Ruffle, J. K., Herron, D., Nelson, A., Bzdok, D., Fernández-Reyes, D., Rees, G. E., & Nachev, P. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00716-4 · Cited by 18
“The variables in the dataset were as follows (UK Biobank field number in brackets): Demographic: Sex (31), Age (33), Smoking (20116), Ethnicity (21000), Townsend Deprivation Index (189); Investigatory: Haemoglobin (30020), Glycated Haemoglobin (30750), Body Mass Index (21001), Weight (21002), Body Fat % (23099); Medic…”
BackgroundPreserving the Fairness Guarantees of Classifiers in Changing Environments: A Survey
Barrainkua, A., Gordaliza, P., Lozano, J. A., & Quadrianto, N. (2025) · ACM Computing Surveys · doi:10.1145/3637438 · Cited by 22
“Several Python packages, including AIF360 [9], Fairlearn [115], and Themis-ML [6], offer comprehensive toolkits and libraries for addressing algorithmic fairness, providing a wide range of fairness metrics and bias mitigation techniques.”
Fairness across Network Positions in Cyberbullying Detection Algorithms
Singh, V., & Hofenbitzer, C. (2019) · International Conference on Advances in Social Networks Analysis and Mining · doi:10.1145/3341161.3342949 · Cited by 14
Features of Human-Centred Algorithm Design
Cherrington, M., Airehrour, D., Lu, J., Xu, Q., Cameron-Brown, D., & Dunn, I. (2020) · International Telecommunication Networks and Applications Conference (ITNAC) · doi:10.1109/itnac50341.2020.9315169 · Cited by 20
A Framework for Democratizing AIPreprint
Ahmed, S., Mula, R., & Dhavala, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.00818 · Cited by 17
Dbias: Detecting biases and ensuring Fairness in news articlesPreprint
Raza, S., Reji, D. J., & Ding, C. (2022) · Research Square · doi:10.21203/rs.3.rs-1356281/v1 · Cited by 15
Fool SHAP with Stealthily Biased SamplingPreprint
Laberge, G., Aïvodji, U., Hara, S., Marchand, M., & Khomh, F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.15419 · Cited by 18
A Fair Individualized Polysocial Risk Score for Identifying Increased Social Risk in Type 2 Diabetes
Huang, Y., Guo, J., Donahoo, W. T., Lee, Y. A., Fan, Z., Lu, Y., Chen, W.-H., Tang, H., Bilello, L., Saguil, A. A., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-52960-9 · Cited by 14
When Biased Humans Meet Debiased AI: A Case Study in College Major Recommendation
Wang, C., Wang, K., Bian, A., Islam, R., Keya, K. N., Foulds, J. R., & Pan, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3611313 · Cited by 17
“From each of the 100 topics, we asked three volunteers to individually select one representative item from the top 10 items identiied by LDA.”
MethodInfluentialHeidrich, L., Slany, E., Scheele, S., & Schmid, U. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5040076 · Cited by 17
Natural Language Processing and Text Mining (Turning Unstructured Data into Structured)
Bagheri, A., Giachanou, A., Mosteiro, P. J., & Verberne, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_5 · Cited by 21
Implementing and analyzing fairness in banking credit scoring
Mariscal, C., Yustiawan, Y., Rochim, F. C., & Tanuar, E. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.03.150 · Cited by 16
LLM-Guided Counterfactual Data Generation for Fairer AI
Mishra, A., Nayak, G., Bhattacharya, S., Kumar, T., Shah, A., & Foltín, M. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651929 · Cited by 14
Decoding the algorithmic operations of Australia's National Disability Insurance Scheme
van Toorn, G., & Carney, T. (2024) · Australian Journal of Social Issues · doi:10.1002/ajs4.342 · Cited by 16
Data augmentation via diffusion model to enhance AI fairness
Blow, C. H., Qian, L., Gibson, C. A., Obiomon, P., & Dong, X. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1530397 · Cited by 19
“For example, AIF360 [3] offers a comprehensive set of fairness metrics for datasets and models, explanations for these metrics, and algorithms to reduce bias in datasets and models concerning protected attributes such as sex and race.”
Moyo, T. J., Gunes, O., & Jirotka, M. D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711016 · Cited by 22
Better together? Human oversight as means to achieve fairness in the European AI Act governance
Correa, A., Garsia, S., & Elbi, A. (2025) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.10010 · Cited by 17
FairDiverse: A Comprehensive Toolkit for Fairness- and Diversity-aware Information Retrieval
Xu, C., Deng, Z., Rus, C., Ye, X., Liu, Y., Xu, J., Dou, Z., Wen, J.-R., & de Rijke, M. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730280 · Cited by 16
Bias in Black Boxes: A Framework for Auditing Algorithmic Fairness in Financial Lending Models
Parasaram, V. K. B. (2023) · Universal Research Reports · doi:10.36676/urr.v10.i3.1631 · Cited by 14
VITAL-ECG: a de-bias algorithm embedded in a gender-immune device
Paviglianiti, A., & Pasero, E. G. A. (2020) · IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT) · doi:10.1109/metroind4.0iot48571.2020.9138291 · Cited by 14
Lamba, H., Rodolfa, K. T., & Ghani, R. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468518 · Cited by 21
“FairML research has grown to span issues around defining bias in machine learning models, enumerating a variety of metrics that can be used to measure model bias [71], detecting instances of it through audit tools [67; 12], and methods for reducing (or mitigating the impact of) bias in ML models [17].”
MethodFairCrowd: Fair Human Face Dataset Sampling via Batch-Level Crowdsourcing Bias Inference
Kou, Z., Zhang, Y., Shang, L., & Wang, D. (2021) · International Workshop on Quality of Service · doi:10.1109/iwqos52092.2021.9521312 · Cited by 14
Self-citationManagement of Artificial Intelligence: Feasibility, Desirability and Viability
Brenner, W., van Giffen, B., & Koehler, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-84655-8_2 · Cited by 20
Assessment of structured data elements for social risk factors
Vest, J. R., Adler-Milstein, J., Gottlieb, L. M., Bian, J., Campion, T. R., Cohen, G. R., Donnelly, N., Harper, J., Huerta, T. R., Kansky, J. P., et al. (2022) · The American Journal of Managed Care · doi:10.37765/ajmc.2022.88816 · Cited by 16
Developing a Novel Fair-Loan Classifier through a Multi-Sensitive Debiasing Pipeline: DualFair
Singh, A., Singh, J., Khan, A., & Gupta, A. D. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4010011 · Cited by 16
Bias and fairness in machine learning and artificial intelligence
Cirillo, D., & Rementeria, M. J. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-821392-6.00006-6 · Cited by 22
Fairness and Transparency in Human-Robot Interaction
Claure, H., Chang, M. L., Kim, S., Omeiza, D., Brandão, M., Lee, M. K., & Jung, M. F. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889421 · Cited by 23
Disentangled Representation with Causal Constraints for Counterfactual Fairness
Xu, Z., Liu, J., Cheng, D., Li, J., Liu, L., & Wang, K. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_37 · Cited by 22
Synthetic Tabular Data Generation for Class Imbalance and Fairness: A Comparative Study
Panagiotou, E., Roy, A. G., & Ntoutsi, E. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-25308-8_3 · Cited by 14
Reranking Individuals: The Effect of Fair Classification Within-Groups
Goethals, S., Favier, M., & Calders, T. (2026) · ACM Journal on Responsible Computing · doi:10.1145/3802540 · Cited by 15
“Numerous debiasing strategies currently exist, but we focus on the methods available in the AIF360 package [3].”
Fair Data Adaptation with Quantile Preservation
Plečko, D., & Meinshausen, N. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000459191 · Cited by 53
How (Not) to Measure Bias in Face Recognition Networks
Glüge, S., Amirian, M., Flumini, D., & Stadelmann, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58309-5_10 · Cited by 16
“This debate on ethical usage of FR technology is part of a larger trend in the machine learning field to account for ethical aspects of the methodology [7, 28], which includes the aspects of trustworthiness(3), transparency (interpretability) [16, 3] and fairness (bias) [4].”
BackgroundQuantifying cognitive bias in educational researchers
Bierema, A. M. ‐., Hoskinson, A.-M., Moscarella, R. A., Lyford, A., Haudek, K. C., MERRILL, J. E., & Urban‐Lurain, M. (2020) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2020.1804541 · Cited by 15
On the suitability, requisites, and challenges of machine learning [Invited]
Morais, R. M. (2020) · Journal of Optical Communications and Networking · doi:10.1364/jocn.401568 · Cited by 17
Link Prediction using Graph Neural Networks for Master Data ManagementPreprint
Ganesan, B., Parkala, S., Singh, N. R., Bhatia, S., Mishra, G., Pasha, M. A., Patel, H., & Naganna, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04732 · Cited by 15
Biases in Data Science LifecyclePreprint
Ho, D.-A., & Beyan, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09795 · Cited by 16
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre OptimizationPreprint
Guo, Q., Chen, J., Wang, D., Yang, Y., Deng, X., Carin, L., Li, F., Huang, J., & Tao, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.01131 · Cited by 14
The Evolution of LLM Adoption in Industry Data Curation PracticesPreprint
Qian, C., Liu, M. X., Reif, E., Simon, G., Hussein, N. M., Clement, N. L., Wexler, J., Cai, C. J., Terry, M., & Kahng, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.16089 · Cited by 17
Large language models for clinical artificial intelligence in healthcare a systematic review
Ghnemat, R., & Saleh, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00784-x · Cited by 17
Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms
Meding, K., & Hagendorff, T. (2024) · Philosophy & Technology · doi:10.1007/s13347-023-00679-8 · Cited by 19
Soni, V. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24may2203 · Cited by 16
Unveiling the Influence of AI on Advancements in Respiratory Care: Narrative Review
Alqahtani, M. Μ., Alanazi, A., Algarni, S. S., Aljohani, H., Alenezi, F. K., Alotaibi, T. F., Alotaibi, M. M., Alqahtani, M. K., Alahmari, M. A., Alwadeai, K. S., et al. (2024) · Interactive Journal of Medical Research · doi:10.2196/57271 · Cited by 13
Yi, F., Singh, A., & Tao, Z. (2024) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000101 · Cited by 17
Fairness in Algorithmic Profiling: The AMAS Case
Achterhold, E., Mühlböck, M., Steiber, N., & Kern, C. A. (2025) · Minds and Machines · doi:10.1007/s11023-024-09706-9 · Cited by 20
Fahad, S. K. A., Zhengkui, D. W., Ng, P. C., Wong, N., Ng, A. B., & See, S. C. W. (2025) · Studies in computational intelligence · doi:10.1007/978-3-031-80334-5_19 · Cited by 18
Analyzing and Mitigating Bias for Vulnerable Road Users by Addressing Class Imbalance in Datasets
Katare, D., Noguero, D. S., Park, S., Kourtellis, N., Janssen, M., & Ding, A. Y. (2025) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2025.3564558 · Cited by 17
“However, the approach can be tested and validated on other driving datasets, e.g., the Waymo dataset [27], where the samples can be Vehicles, Pedestrians, and Cyclists.”
Predicting Agitation Events in the Emergency Department Through Artificial Intelligence
Wong, A. H.-W., Sapre, A. V., Wang, K., Nath, B., Shah, D., Kumar, A. P., Faustino, I. V., Desai, R., Hu, Y. H., Robinson, L., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.8927 · Cited by 13
Technical analysis of AI-driven solutions for aligning HR policies with employee satisfaction
Nahar, K., Faruq, O., & Rayhan, Z. (2025) · Информатика Экономика Управление - Informatics Economics Management · doi:10.47813/2782-5280-2025-4-2-3038-3048 · Cited by 13
ML4H Auditing: From Paper to Practice
Oala, L., Fehr, J., Gilli, L., Balachandran, P., Leite, A. W., Calderón-Ramírez, S., Xie-Li, D., Nobis, G., Alvarado, E. A. M., Jaramillo-Gutierrez, G., et al. (2020) · SERVAL (Université de Lausanne) · Cited by 50
Data Augmentation for Fairness in Personal Knowledge Base Population
Vannur, L. S., Ganesan, B., Nagalapatti, L., Patel, H., & Tippeswamy, M. N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75015-2_15 · Cited by 19
Alam, M. A. U. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21545 · Cited by 14
Maw, M., Haw, S.-C., & Ho, C.-K. (2021) · F1000Research · doi:10.12688/f1000research.72929.1 · Cited by 16
Exploiting Fairness to Enhance Sensitive Attributes Reconstruction
Ferry, J., Aïvodji, U., Gambs, S., Huguet, M., & Siala, M. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00012 · Cited by 22
Cascaded Debiasing: Studying the Cumulative Effect of Multiple Fairness-Enhancing Interventions
Ghai, B., Mishra, M., & Mueller, K. D. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557155 · Cited by 15
“Wehave used IBM’s AIF 360 [5] open source toolkit to conduct all experiments for this paper.”
MethodEnforcing fairness using ensemble of diverse Pareto-optimal models
Guardieiro, V., Raimundo, M. M., & Poco, J. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00922-y · Cited by 18
“These datasets are frequently used in Fairness, they are not class-balanced, and Bellamy et al. did the pre-processing in Bellamy et al. (2019).”
MethodOptimizing fairness tradeoffs in machine learning with multiobjective meta-models
Cava, W. L. (2023) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3583131.3590487 · Cited by 19
Bias Detection for Customer Interaction Data: A Survey on Datasets, Methods, and Tools
Donald, A., Galanopoulos, A., Curry, E., Muñoz, E., Ullah, I., Waskow, M. A., Dabrowski, M., & Kalra, M. (2023) · IEEE Access · doi:10.1109/access.2023.3276757 · Cited by 16
Understanding the Dataset Practitioners Behind Large Language Models
Qian, C., Reif, E., & Kahng, M. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651007 · Cited by 16
When Mitigating Bias is Unfair: Multiplicity and Arbitrariness in Algorithmic Group Fairness
Krčo, N., Laugel, T., Grari, V., Loubes, J., & Detyniecki, M. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00046 · Cited by 14
Learning Unbiased Representations via Rényi Minimization
Grari, V., Hajouji, O. E., Lamprier, S., & Detyniecki, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86520-7_46 · Cited by 30
Fair and accurate age prediction using distribution aware data curation and augmentation
Cao, Y., Berend, D., Tolmach, P., Amit, G., Levy, M., Liu, Y., Shabtai, A., & Elovici, Y. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00292 · Cited by 18
Fair CRISP-DM: Embedding Fairness in Machine Learning (ML) Development Life Cycle
Singh, V. K., Singh, A., & Joshi, K. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.190 · Cited by 17
Big Data in Stroke: How to Use Big Data to Make the Next Management Decision
Liu, Y., Luo, Y., & Naidech, A. M. (2023) · Neurotherapeutics · doi:10.1007/s13311-023-01358-4 · Cited by 13
Ghosh, B., Basu, D., & Meel, K. S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593983 · Cited by 22
MorphGAN: One-Shot Face Synthesis GAN for Detecting Recognition Bias
Ruiz, N., Theobald, B. J., Ranjan, A., Abdelaziz, A. H., & Apostoloff, N. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.67 · Cited by 15
Little, C. O., Weylandt, M., & Allen, G. I. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.00074 · Cited by 15
FADE: FAir Double Ensemble Learning for Observable and Counterfactual OutcomesPreprint
Mishler, A., & Kennedy, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00173 · Cited by 13
Finding Representative Group Fairness Metrics Using Correlation EstimationsPreprint
Anahideh, H., Nezami, N., & Asudeh, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05697 · Cited by 14
‘Led by Intelligence': A Scoping Review on the Experimental Evaluation of Intelligence-Led Policing
Khalfa, R., & Hardyns, W. (2024) · Evaluation Review · doi:10.1177/0193841x231204588 · Cited by 12
Singh, C. (2025) · Journal of Financial Crime · doi:10.1108/jfc-07-2024-0232 · Cited by 12
How fair are we? From conceptualization to automated assessment of fairness definitions
d’Aloisio, G., Sipio, C. D., Marco, A. D., & Ruscio, D. D. (2025) · Software & Systems Modeling · doi:10.1007/s10270-025-01277-2 · Cited by 16
“Afterwards, the fairness analysis phase could be conducted by means of a set of predefined implementations of the state-of-the-art fairness metrics (taken from the AIF360 library [7]).”
Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection
Jung, J.-Y., Saxena, D., Park, M., Kim, J., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735745 · Cited by 14
A Comprehensive Review of Bias in AI, ML, and DL Models: Methods, Impacts, and Future Directions
Kumar, A., Dhanka, S., Sharma, A., Sharma, A., Nain, M., Kumar, P., Gupta, A. R., Bansal, J., Saxena, N. K., & Pant, R. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10483-6 · Cited by 19
Epistemic Uncertainty-Weighted Loss for Visual Bias Mitigation
Stone, R. S., Ravikumar, N., Bulpitt, A. J., & Hogg, D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00327 · Cited by 21
Pagano, T. P., Loureiro, R. B., Lisboa, F. V. N., Cruz, G. O. R., Peixoto, R. M., Guimarães, G. A. D. S., Oliveira, E. L. S., Winkler, I., & Nascimento, E. G. S. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010027 · Cited by 14
Privacy-Preserving and Trustless Verifiable Fairness Audit of Machine Learning Models
Tang, G., Tan, W., & Cai, M. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140294 · Cited by 17
“To address this formally, many works towards considering how algorithm fairness can be assessed by proposing various measures and how discrimination in machine learning systems can be mitigated by pre-processing [9], [10], inter-processing [11], [12], and post-processing methods [5] [13].”
BackgroundFairCompass: Operationalizing Fairness in Machine Learning
Liu, J., Chen, H., Shen, J., & Choo, K. R. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3348429 · Cited by 13
“Other existing works, such as Aequitas [5], AI Fairness 360 [4], Google’s What-If Tool [12], also present promising results in the venue of novel approaches to fairness research as they aim to address problems commonly encountered by practitioners according to fairness related literature.”
BackgroundBias and Discrimination in Artificial Intelligence: Emergence and Impact in E-Business
Weyerer, J. C., & Langer, P. F. (2020) · Advances in e-business research series · doi:10.4018/978-1-7998-1879-3.ch011 · Cited by 14
FairyTED: A Fair Rating Predictor for TED Talk Data
Acharyya, R., Das, S., Chattoraj, A., & Tanveer, M. I. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5368 · Cited by 7
Balancing Utility and Fairness against Privacy in Medical Data
Chester, A., Koh, Y. S., Wicker, J. S., Sun, Q., & Lee, J. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308226 · Cited by 12
“There is often a trade-off between utility and fairness [5].”
BackgroundA fair classifier chain for multi‐label bank marketing strategy classification
Radovanović, S., Petrović, A., Delibašić, B., & Suknović, M. (2021) · International Transactions in Operational Research · doi:10.1111/itor.13059 · Cited by 14
Feature and Label Embedding Spaces Matter in Addressing Image Classifier Bias
Thong, W. E., & Snoek, C. G. M. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.46 · Cited by 17
Fairness & friends in the data science era
Catania, B., Guerrini, G., & Accinelli, C. (2022) · AI & Society · doi:10.1007/s00146-022-01472-5 · Cited by 18
“Among them, the open-source Python toolkit for algorithmic fairness, AI Fairness 360 (Bellamy et al. 2019), and FairTest (Tramer et al. 2017) support the user in checking algorithmic fairness and associations between application outcomes (such as prices or premiums) and sensitive user attributes…”
MethodWhen More Data Lead Us Astray: Active Data Acquisition in the Presence of Label Bias
Li, Y., De‐Arteaga, M., & Saar‐Tsechansky, M. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21994 · Cited by 17
Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial BrainPreprint
Zhou, Y., & Jiang, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06673 · Cited by 19
Ten simple rules for building and maintaining a responsible data science workflow
Stoudt, S., Jernite, Y., Marshall, B., Marwick, B., Sharan, M., Whitaker, K., & Danchev, V. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1012232 · Cited by 11
Critical data ethics pedagogies: Three (non-rival) approaches
Murillo, L. F. R., Wylie, C. D., & Bourne, P. E. (2023) · Big Data & Society · doi:10.1177/20539517231203666 · Cited by 11
Group Fairness via Group Consensus
Chan, E., Liu, Z., Qiu, R., Zhang, Y., Maciejewski, R., & Tong, H. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659006 · Cited by 27
Self-citation
Metadata
- Authors
- Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., Nagar, S., Ramamurthy, K. N., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K. R., & Zhang, Y.
- ORCID
- Venue
- IBM Journal of Research and Development
- Publisher
- IBM
- Published
- 2019-07-01
- Volume
- 63
- Issue
- 4/5
- Pages
- 4:1-4:15
- ISSN
- 0018-8646 (ISSN-L)
- OpenAlex
- W2974817986
- Cited by
- 884
- References
- 31
- Citations by year
- 2026: 163 · 2025: 226 · 2024: 145 · 2023: 143 · 2022: 99 · 2021: 69 · 2020: 35 · 2019: 4
- FWCI
- 90.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IBM Journal of Research and Development (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Keywords
- algorithmic fairness, algorithmic bias detection, bias mitigation, fairness metrics, open-source software toolkit, high-stakes decision making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.