AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
The DOI matches its Crossref record; 28 of the 31 references it cites were found in a registry or an index.
Abstract
Fairness is an increasingly important concern as machine learning models are used to support decision making in high-stakes applications such as mortgage lending, hiring, and prison sentencing. This article introduces a new open-source Python toolkit for algorithmic fairness, AI Fairness 360 (AIF360), released under an Apache v2.0 license (https://github.com/ibm/aif360). The main objectives of this toolkit are to help facilitate the transition of fairness research algorithms for use in an industrial setting and to provide a common framework for fairness researchers to share and evaluate algorithms. The package includes a comprehensive set of fairness metrics for datasets and models, explanations for these metrics, and algorithms to mitigate bias in datasets and models. It also includes an interactive Web experience that provides a gentle introduction to the concepts and capabilities for line-of-business users, researchers, and developers to extend the toolkit with their new algorithms and improvements and to use it for performance benchmarking. A built-in testing infrastructure maintains code quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the Linux Foundation, which hosts several of the open source tools we found (IBM's AI Fairness 360 [15], for example).”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“An open-source toolkit, the AI Fairness 360, is available to help AI researchers examine, report, and mitigate discrimination and bias in machine learning models throughout the AI development lifecycle [52].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“It includes a comprehensive set of metrics for datasets and models to test for biases, explanations for those metrics, and algorithms to mitigate bias in datasets and models.”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“If bias is discovered in an algorithm, a variety of solutions are now available to help mitigate and reduce the level of bias (Bellamy et al., 2019).”
From Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health (2021) · cites this paper as Bellamy et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Various toolboxes have been released in the past years to assist the algorithm experimentation and software development to enhance AI trustworthiness in different aspects such as fairness [12, 13, 71], XAI [56, 1, 8], and adversarial robustness [55, 2].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [12]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Mitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387
Data preprocessing techniques for classification without discrimination
Kamiran, F., & Calders, T. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0463-8 · Cited by 1,305
(2013) · Cited by 1,126
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995
Optimized Pre-Processing for Discrimination Prevention
Calmon, F. P., Wei, D., Vinzamuri, B., Ramamurthy, K. N., & Varshney, K. R. (2017) · neural information processing systems · Cited by 978
Self-citationInherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943
Research works printed but not linked: 4
- Kohavi, R. Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining , 1996. URL https://archive. ics.uci.edu/ml/datasets/adult .
- Kusner, M. J., Loftus, J. R., Russell, C., and Silva, R. Counterfactual fairness. In NIPS , 2017.
- bellamy, 2018, AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias, arXiv 1810 01943
- Narayanan, A. Translation tutorial: 21 fairness definitions and their politics. In Conference on Fairness, Accountability, and Transparency , February 2018.
Cited by
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
Baker, R. S., & Hawn, A. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00285-9 · Cited by 993
“Efforts are already underway to create domain-general packages for algorithmic bias/fairness metrics, and their developers welcome external contributions (Bellamy et al., 2019).”
BackgroundExplainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957
Addressing bias in big data and AI for health care: A call for open science
Norori, N., Hu, Q., Aellen, F. M., Faraci, F. D., & Tzovara, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100347 · Cited by 903
“36 Human bias .”
AI Alignment: A Contemporary Survey
Ji, J., Qiu, T., Chen, B., Zhou, J., Zhang, B., Hong, D., Lou, H., Wang, K., Duan, Y., He, Z., et al. (2025) · ACM Computing Surveys · doi:10.1145/3770749 · Cited by 809
Shneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768
“Beyond detecting biases, researchers offer fairness-enhancing interventions [38] and companies have developed commercial grade toolkits for detecting and mitigating algorithmic bias [7].”
BackgroundAldoseri, A., Al-Khalifa, K. N., & Hamouda, A. M. (2023) · Applied Sciences · doi:10.3390/app13127082 · Cited by 716
Trustworthy Artificial Intelligence: A Review
Kaur, D., Uslu, S., Rittichier, K. J., & Durresi, A. (2023) · ACM Computing Surveys · doi:10.1145/3491209 · Cited by 709
“[14] developed an open source toolkit to use fairness algorithms in an industrial setting.”
BackgroundFairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646
Bias in artificial intelligence algorithms and recommendations for mitigation
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000278 · Cited by 621
“An open-source toolkit, the AI Fairness 360, is available to help AI researchers examine, report, and mitigate discrimination and bias in machine learning models throughout the AI development lifecycle [52].”
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
Trustworthy artificial intelligence
Thiebes, S., Lins, S., & Sunyaev, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00441-4 · Cited by 595
“Next to the limited availability of high-quality training data, training data that are already available are routinely biased toward certain groups of people, which in the past has led to the implicit discrimination of those groups of people that are underrepresented in the training data (Bellamy et al. 2019).”
BackgroundInfluentialData collection and quality challenges in deep learning: a data-centric AI perspective
Whang, S. E., Roh, Y., Song, H., & Lee, J.-G. (2023) · The VLDB Journal · doi:10.1007/s00778-022-00775-9 · Cited by 573
“Although there are many ways to measure fairness, one would ultimately like to perform unfairness mitigation [26, 28].”
BackgroundTowards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
The What-If Tool: Interactive Probing of Machine Learning Models
Wexler, J., Pushkarna, M., Bolukbasi, T., Wattenberg, M., Viegas, F., & Wilson, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934619 · Cited by 505
Six Human-Centered Artificial Intelligence Grand Challenges
Ozmen Garibay, O., Winslow, B., Andolina, S., Antona, M., Bodenschatz, A., Coursaris, C., Falco, G., Fiore, S. M., Garibay, I., Grieman, K., et al. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2153320 · Cited by 501
Aequitas: A Bias and Fairness Audit Toolkit
Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K. T., & Ghani, R. (2018) · arXiv · doi:10.48550/arxiv.1811.05577 · Cited by 496
Schiff, D. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00270-2 · Cited by 489
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436
FactSheets: Increasing trust in AI services through supplier's declarations of conformity
Arnold, M., Bellamy, R. K. E., Hind, M., Houde, S., Mehta, S., Mojsilović, A., Nair, R., Ramamurthy, K. N., Olteanu, A., Piorkowski, D., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942288 · Cited by 434
Self-citationArmoundas, A. A., Narayan, S. M., Arnett, D. K., Spector-Bagdady, K., Bennett, D. A., Celi, L. A., Friedman, P. A., Gollob, M. H., Hall, J. L., Kwitek, A. E., et al. (2024) · Circulation · doi:10.1161/cir.0000000000001201 · Cited by 347
“173,174 The intersection of social identities should consider, when necessary, debiasing techniques to decrease variation in performance across subgroups.”
BackgroundWhy fairness cannot be automated: Bridging the gap between EU non-discrimination law and AI
Wachter, S., Mittelstadt, B., & Russell, C. (2021) · Computer Law & Security Review · doi:10.1016/j.clsr.2021.105567 · Cited by 336
Camilleri, M. A. (2024) · Expert Systems · doi:10.1111/exsy.13406 · Cited by 331
“The responsible AI's fairness dimension refers to the practitioners ’ attempts to correct algorithmic biases that may possibly (voluntarily or involun-tarily) be included in their automation processes (Bellamy et al., 2019; Mäntymäki et al., 2022).”
BackgroundAUC Maximization in the Era of Big Data and AI: A Survey
Yang, T., & Ying, Y. (2023) · ACM Computing Surveys · doi:10.1145/3554729 · Cited by 323
Pagano, T. P., Loureiro, R. B., Lisboa, F. V. N., Peixoto, R. M., Guimarães, G. A. S., Cruz, G. O. R., Araujo, M. M., Santos, L. L., Cruz, M. A. S., Oliveira, E. L. S., et al. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010015 · Cited by 311
“Some solutions, such as AIF360 [12], FairLearn [13], Tensorflow Responsible AI [5,14,15] and Aequitas [16] are designed specifically to address bias and unfairness.”
BackgroundFletcher, R. R., Nakeshimana, A., & Olubeko, O. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.561802 · Cited by 305
“If bias is discovered in an algorithm, a variety of solutions are now available to help mitigate and reduce the level of bias (Bellamy et al., 2019).”
Ahmad, K., Maabreh, M., Ghaly, M., Khan, K., Qadir, J., & Al-Fuqaha, A. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2021.100452 · Cited by 291
Defining organizational AI governance
Mäntymäki, M., Minkkinen, M., Birkstedt, T., & Viljanen, M. (2022) · AI and Ethics · doi:10.1007/s43681-022-00143-x · Cited by 285
“These include, for example, tools for data governance [27], explainable AI (XAI) [28], and bias detection [29].”
MethodShould ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · arXiv · doi:10.48550/arxiv.2304.03738 · Cited by 282
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
Can HR adapt to the paradoxes of artificial intelligence?
Charlwood, A., & Guenole, N. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12433 · Cited by 271
A high-level overview of AI ethics
Kazim, E., & Koshiyama, A. S. (2021) · Patterns · doi:10.1016/j.patter.2021.100314 · Cited by 269
A High-Level Overview of AI Ethics
Kazim, E., & Koshiyama, A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3609292 · Cited by 269
How do Data Science Workers Collaborate? Roles, Workflows, and Tools
Zhang, A. X., Muller, M., & Wang, D. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392826 · Cited by 268
Demographic Bias in Biometrics: A Survey on an Emerging Challenge
Drozdowski, P., Rathgeb, C., Dantcheva, A., Damer, N., & Busch, C. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2992344 · Cited by 263
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Self-citationTrustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
Ashmore, R., Calinescu, R., & Paterson, C. (2022) · ACM Computing Surveys · doi:10.1145/3453444 · Cited by 256
“An industry-ready toolkit that implements a range of methods for addressing unwanted bias is available [16].”
BackgroundYoung, M. M., Bullock, J. B., & Lecy, J. D. (2019) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvz014 · Cited by 255
Putting AI ethics to work: are the tools fit for purpose?
Ayling, J., & Chapman, A. (2022) · AI and Ethics · doi:10.1007/s43681-021-00084-x · Cited by 253
Trunk, A., Birkel, H., & Hartmann, E. (2020) · Business Research · doi:10.1007/s40685-020-00133-x · Cited by 252
“Nonetheless, ethical frameworks must still be developed, although this perspective is discussed with increasing awareness (Bellamy et al. 2019; Parisi 2019; Shank et al. 2019; Webb et al. 2019).”
BackgroundFairAIED: Navigating Fairness, Bias, and Ethics in Educational AI ApplicationsPreprint
Yin, Z., Chinta, S. V., Wang, Z., Gonzalez, M., & Zhang, W. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.18745 · Cited by 287
Pessach, D., & Shmueli, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-24628-9_37 · Cited by 286
How can we manage biases in artificial intelligence systems – A systematic literature review
P.S., D. V. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100165 · Cited by 239
van Giffen, B., Herhausen, D., & Fahse, T. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.076 · Cited by 230
Sharma, S., Henderson, J., & Ghosh, J. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375812 · Cited by 226
Bias in machine learning software: why? how? what to do?
Chakraborty, J., Majumder, S., & Menzies, T. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468537 · Cited by 224
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
Hort, M., Chen, Z., Zhang, J. M., Harman, M., & Sarro, F. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3631326 · Cited by 219
Fairness in Deep Learning: A Computational Perspective
Du, M., Yang, F., Zou, N., & Hu, X. (2021) · IEEE Intelligent Systems · doi:10.1109/mis.2020.3000681 · Cited by 215
Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations
Mökander, J., Morley, J., Taddeo, M., & Floridi, L. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00319-4 · Cited by 207
Akinrinola, O., Okoye, C. C., Ofodile, O. C., & Ugochukwu, C. E. (2024) · GSC Advanced Research and Reviews · doi:10.30574/gscarr.2024.18.3.0088 · Cited by 206
Systematic Inequalities in Language Technology Performance across the World’s Languages
Blasi, D., Anastasopoulos, A., & Neubig, G. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.376 · Cited by 97
Machine Learning for Financial Risk Management: A Survey
Mashrur, A., Luo, W., Zaidi, N. A., & Robles-Kelly, A. (2020) · IEEE Access · doi:10.1109/access.2020.3036322 · Cited by 200
Laine, J., Minkkinen, M., & Mäntymäki, M. (2024) · Information & Management · doi:10.1016/j.im.2024.103969 · Cited by 224
Scheuerman, M. K., Wade, K., Lustig, C., & Brubaker, J. R. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392866 · Cited by 193
“Machine learning researchers have proposed numerous statistical approaches (e.g., [35]) and toolkits (e.g., [17]) for mitigating bias.”
BackgroundAlgorithmic fairness in education
Kizilcec, R. F., & Lee, H. (2022) · The Ethics of Artificial Intelligence in Education · doi:10.4324/9780429329067-10 · Cited by 193
AI and the quest for diversity and inclusion: a systematic literature review
Shams, R. A., Zowghi, D., & Bano, M. (2025) · AI and Ethics · doi:10.1007/s43681-023-00362-w · Cited by 192
Operationalising AI governance through ethics-based auditing: an industry case study
Mökander, J., & Floridi, L. (2023) · AI and Ethics · doi:10.1007/s43681-022-00171-7 · Cited by 129
“Rather, organisations should undertake a gap finding and filling exercise, adding ethics-based evaluation criteria to existing procurement processes.”
BackgroundAn artificial intelligence life cycle: from conception to production
De Silva, D., & Alahakoon, D. (2022) · Patterns · doi:10.1016/j.patter.2022.100489 · Cited by 189
Evaluation and Mitigation of Racial Bias in Clinical Machine Learning Models: Scoping Review
Huang, J., Galal, G., Etemadi, M., & Vaidyanathan, M. (2022) · JMIR Medical Informatics · doi:10.2196/36388 · Cited by 186
“Some examples of these resources include Aequitas, Artificial Intelligence Fairness 360 (IBM, Armonk, NY, United States), and Fairlearn (Microsoft Corporation, Redmond, WA, United States) [53,54].”
Chang, Y.-L., & Ke, J. (2024) · Human Resource Development Review · doi:10.1177/15344843231200930 · Cited by 131
“Moreover, some researchers suggested that AI-enabled PA should use data aggregation methods or remove identi fi able information to ensure data privacy and reduce the possible bias embedded (Bellamy et al., 2019; Boulemtafes et al., 2020).”
BackgroundJaved, H., El-Sappagh, S., & Abuhmed, T. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-11005-9 · Cited by 180
Ethical Considerations in AI-Based Recruitment
Mujtaba, D. F., & Mahapatra, N. R. (2019) · 2019 IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas48451.2019.8937920 · Cited by 132
Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset
Meng, C., Trinh, L., Xu, N., Enouen, J., & Liu, Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-11012-2 · Cited by 174
Singhal, A., Neveditsin, N., Tanveer, H., & Mago, V. (2024) · JMIR Medical Informatics · doi:10.2196/50048 · Cited by 172
“The AI Fairness 360 toolkit [43] provides metrics and algorithms designed to reduce statistical biases that lead to the unfair treatment of various groups by ML models [44].”
MethodFairway: a way to build fair ML software
Chakraborty, J., Majumder, S., Yu, Z., & Menzies, T. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409697 · Cited by 130
Algorithmic fairness in computational medicine
Xu, J., Xiao, Y., Wang, W. H., Ning, Y., Shenkman, E. A., Bian, J., & Wang, F. (2022) · eBioMedicine · doi:10.1016/j.ebiom.2022.104250 · Cited by 170
Amin, M. Y. M. (2023) · International Journal of Higher Education Pedagogies · doi:10.33422/ijhep.v4i4.554 · Cited by 197
“This can impact the diversity and inclusivity of content and hinder effective language learning (Zou, 2018).”
BackgroundA review of predictive policing from the perspective of fairness
Alikhademi, K., Drobina, E., Prioleau, D., Richardson, B., Purves, D., & Gilbert, J. E. (2022) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09286-4 · Cited by 167
Brain imaging with portable low-field MRI
Kimberly, W. T., Sorby-Adams, A. J., WEBB, A. G., Wu, E. X., Beekman, R. B., Bowry, R., Schiff, S. J., de Havenon, A., Shen, F. X., Sze, G. K., et al. (2023) · Nature Reviews Bioengineering · doi:10.1038/s44222-023-00086-w · Cited by 187
Gender bias perpetuation and mitigation in AI technologies: challenges and opportunities
O’Connor, S., & Liu, H. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01675-4 · Cited by 165
Investigating Bias and Fairness in Facial Expression Recognition
Xu, T., White, J., Kalkan, S., & Gunes, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-65414-6_35 · Cited by 165
An empirical characterization of fair machine learning for clinical risk prediction
Pfohl, S. R., Foryciarz, A., & Shah, N. H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103621 · Cited by 164
Fairness and Explanation in AI-Informed Decision Making
Angerschmid, A., Zhou, J., Theuermann, K., Chen, F., & Holzinger, A. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4020026 · Cited by 161
Gupta, M., Parra, C. M., & Dennehy, D. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10156-2 · Cited by 129
Fairness Testing: A Comprehensive Survey and Analysis of Trends
Chen, Z., Zhang, J. M., Hort, M., Harman, M., & Sarro, F. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3652155 · Cited by 201
Floridi, L., Holweg, M., Taddeo, M., Amaya, J., Mökander, J., & Wen, Y. (2022) · doi:10.2139/ssrn.4064091 · Cited by 157
“Shortcuts” Causing Bias in Radiology Artificial Intelligence: Causes, Evaluation, and Mitigation
Banerjee, I., Bhattacharjee, K., Burns, J. L., Trivedi, H., Purkayastha, S., Seyyed-Kalantari, L., Patel, B. N., Shiradkar, R., & Gichoya, J. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.06.025 · Cited by 122
A Comprehensive Survey of Artificial Intelligence Techniques for Talent Analytics
Qin, C., Zhang, L., Cheng, Y., Zha, R., Shen, D., Zhang, Q., Chen, X., Sun, Y., Zhu, C., Zhu, H., et al. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3572744 · Cited by 174
From Reality to World. A Critical Perspective on AI Fairness
John-Mathews, J.-M., Cardon, D., & Balagué, C. (2022) · Journal of Business Ethics · doi:10.1007/s10551-022-05055-8 · Cited by 130
Algorithmic discrimination in the credit domain: what do we know about it?
García, A. C. B., García, M., & C, R. R. B. (2023) · AI & Society · doi:10.1007/s00146-023-01676-3 · Cited by 171
“…the requirements for achieving fair algorithms (Kleinberg et al. 2016), mathematically defining metrics to measure a system’s degree of fairness Kearns (2017), or even offering a programming library containing many different definitions to be able to compute and compare (Bellamy et al. 2019).”
Laux, J., Wachter, S., & Mittelstadt, B. (2024) · Computer Law & Security Review · doi:10.1016/j.clsr.2024.105957 · Cited by 110
Considerations for AI fairness for people with disabilities
Trewin, S., Basson, S., Muller, M., Branham, S., Treviranus, J., Gruen, D., Hebert, D., Lyckowski, N., & Manser, E. (2019) · AI Matters · doi:10.1145/3362077.3362086 · Cited by 143
Bogina, V., Hartman, A., Kuflik, T., & Shulner-Tal, A. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00248-0 · Cited by 142
Retiring Adult: New Datasets for Fair Machine LearningPreprint
Ding, F., Hardt, M., Miller, J. A., & Schmidt, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04884 · Cited by 600
Bias Mitigation Post-processing for Individual and Group Fairness
Lohia, P. K., Natesan Ramamurthy, K., Bhide, M., Saha, D., Varshney, K. R., & Puri, R. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682620 · Cited by 120
Self-citationMinkkinen, M., Laine, J., & Mäntymäki, M. (2022) · Digital Society · doi:10.1007/s44206-022-00022-2 · Cited by 88
“AI Fairness 360 by Bellamy et al. (2019) and FlipTest by Black et al. (2020) focused on fairness issues in AI systems.”
BackgroundAI Ethics Principles in Practice: Perspectives of Designers and Developers
Sanderson, C., Douglas, D., Lu, Q., Schleiger, E., Whittle, J., Lacey, J., Newnham, G., Hajkowicz, S., Robinson, C., & Hansen, D. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3257303 · Cited by 99
Deep Learning and Medical Image Analysis for COVID-19 Diagnosis and Prediction
Liu, T., Siegel, E. L., & Shen, D. G. (2022) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-110220-012203 · Cited by 160
Structural racism in precision medicine: leaving no one behind
Geneviève, L. D., Martani, A., Shaw, D., Elger, B. S., & Wangmo, T. (2020) · BMC Medical Ethics · doi:10.1186/s12910-020-0457-8 · Cited by 125
A survey on artificial intelligence assurance
Batarseh, F. A., Freeman, L., & Huang, C. (2021) · Journal Of Big Data · doi:10.1186/s40537-021-00445-7 · Cited by 156
“2018 Mason [143] AHIM RL 7 2018 Murray [157] FUZZ‐IEEE XAI 7 2019 Naqa [66] MedPhys ML 7 2019 Prentzas [174] IEEE BIBE XAI 7 2018 Pynadath [177] Springer HCIS ML 7 2020 Ragot [179] CHI ML 7 2020 Rotman [184] PrePrint RL 7 2015 Rovcanin [185] WN RL 7 2020 Sarathy [188] IEEE SISY XAI 7 2018 Stock [203] ECCV CV 7 2009 Ta…”
BackgroundSrinivasan, R., & Chander, A. (2021) · Communications of the ACM · doi:10.1145/3464903 · Cited by 104
Research gaps and opportunities in precision nutrition: an NIH workshop report
Lee, B. Y., Ordovás, J. M., Parks, E. J., Anderson, C. A. M., Barabási, A.-Ĺ., Clinton, S. K., de la Haye, K., Duffy, V. B., Franks, P. W., Ginexi, E. M., et al. (2022) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqac237 · Cited by 145
Z-Inspection ® : A Process to Assess Trustworthy AI
Zicari, R. V., Brodersen, J., Brusseau, J., Dudder, B., Eichhorn, T., Ivanov, T., Kararigas, G., Kringen, P., McCullough, M., Moslein, F., et al. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3066209 · Cited by 134
Ethical Principles and Governance Technology Development of AI in China
Wu, W., Huang, T., & Gong, K. (2020) · Engineering · doi:10.1016/j.eng.2019.12.015 · Cited by 113
The Landscape and Gaps in Open Source Fairness Toolkits
Lee, M. S. A., & Singh, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445261 · Cited by 129
“The six fairness toolkits were selected and reviewed through the focus group: scikit-fairness / scikit-lego [41], IBM Fairness 360 (AIF360) [4], Aequitas Tool [33], Google What-if tool [44], and Fair-learn [29].”
BackgroundMethodInfluentialFair Attribute Classification through Latent Space De-biasing
Ramaswamy, V. V., Kim, S. S. Y., & Russakovsky, O. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00918 · Cited by 117
Biswas, S., & Rajan, H. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468536 · Cited by 100
Metadata
- Authors
- Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., Nagar, S., Ramamurthy, K. N., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K. R., & Zhang, Y.
- ORCID
- Venue
- IBM Journal of Research and Development
- Publisher
- IBM
- Published
- 2019-07-01
- Volume
- 63
- Issue
- 4/5
- Pages
- 4:1-4:15
- ISSN
- 0018-8646 (ISSN-L)
- OpenAlex
- W2974817986
- Cited by
- 884
- References
- 31
- Citations by year
- 2026: 163 · 2025: 226 · 2024: 145 · 2023: 143 · 2022: 99 · 2021: 69 · 2020: 35 · 2019: 4
- FWCI
- 90.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IBM Journal of Research and Development (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Keywords
- algorithmic fairness, algorithmic bias detection, bias mitigation, fairness metrics, open-source software toolkit, high-stakes decision making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.